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UNITED STATES DISTRICT COURT] 

EASTERN DISTRICT OF NEW YORKl 

i 

BLUE CROSS AND BLUE SHIELD OF ) 

NEW JERSEY, et al., ) 

Plaintiff(s), ) case Number 

i 

) 98 Civ. 3287(JBW) 
S. ) ! 


PHILIP 
et al. 



INCORPORATED, 


Defendant(s). ) 


-j 

April 20, 2001 
12:09 p.m. 


/ideotaped Deposition of JjON A. 

^K, held at the offices ofi Arnold 

J 

& Porter, 399 Park Avenue, New York, New 

| 

York, before MayLeen Cintron, a Notary 
Public of the State of New York.! 
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IT IS HEREBY STIPULATED;AND 
AGREED by and between the attorneys 
for the respective parties herein, 
that the filing, sealing and j 
certification of the within deposition 
blrwaived. 

yjjjlj IT IS FURTHER STIPULATED AND 
that all objections, except 
a |ptoif the form of the question, 

I ! 

< be reserved to the time]of the 

> i 

IT IS FURTHER STIPULATED AND 

i 

, l . 

that the within deposition 
e sworn to and signed bejfore 
ficer authorized to administer 
h with the same force and 
as if signed and sworn; to 

i 

before the Court 
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THE VIDEOGRAPHER: Thisj is tape 
number one of the videotaped ^deposition 
of Jon A. Krosnick taken by defendants 
in the matter of Blue Cross and Blue 
Shield of New Jersey, et al.,j Plaintiff, 
versus Philip Morris, Incorporated, et 

defendant, in the United (States 

1 ! 

|ict Court, Eastern Distract of New 

0 number CV-98-3287 (JCW)j. This 

! 

! 

sition is being held at Arnold & 
loite r, 399 Park Avenue, New jyork. New 
on April 20, 2001. 

1 The time is 12:09 p.m. j My name is 


is Delvecchio from the firm of 

jhebion Court Reporting, I am the legal 

j 

specialist. The court Ireporter is 
ien Cintron in association with 
lion Court Reporting at 545 Fifth 
Avenue, New York, New York, j 

For the record, will ccjunsel 
please introduce themselves? | 

MR. BSCHORR: Paul Bscliorr of 

i 

Dewey Ballantine on behalf of Blue Cross 

and Blue Shield. i 
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MR. HARMAN: Jason Harman also 

i 

with Dewey Ballantine. 

MR. MASSARO: John Mass^ro of 
Arnold & Porter on behalf of Philip 
Morris, Incorporated. 

K MS. McGINNIS:: Amy McGijnnis also 

...i j 

:h Arnold & Porter on behalf of Philip 



JON L-A, 


MR. BAILEY: William Bailey of 
oilier Shannon Scott on behajlf of 

ynolds Tobacco Company, and with me 
i|Robert Fenili. 

2 the. VIDEOGRAPHER: Will the court 
ter please swear in the jwitness? 

K R 0 S N I C K, called as 

l 

ness, having been duly sworn by a 
y Public, was examined and 
fied as follows: 

THE REPORTER: Please state your 
full name for the record. i 





THE WITNESS: 
EXAMINATION BY 


Jon A. Krosnick. 


24 MR. MASSARO: 

25 Q. Okay. Dr. Krosnick, welcome. As 


i 
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Krosnick 

you heard and as we mentioned before, my name 

i 

is John Massaro and I'm representing Defendant 

i 

J 

Philip Morris in this action. 1 

I 

This is your third deposition in 

i 

this case; is that correct? 

AK,_ , Yes, it is. 

(Krosnick Exhibit 1, Supplemental 

l 

jsure Report, marked forj 
fication, as of this date.) 


■And we've placed in front of you 
1. Can you identify that, please? 
Yes. This is a Supplemental 
eport that I believe was submitted 
ecently representing additional 
on my analysis. 

Have you before you — !T assume 

L 

^ the supplemental disclosure? 


A. *Yes, I did. | 

Q. Before you drafted it, did you 

i 

have a chance to review your prior testimony 

* 

in the case, in the two previous depositions? 
A. I had certainly reviewed all of 

I 

that some time prior to when I started working 
on this, yes. 
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Krosnick J 

| 

Q. Some time prior to when;you 
started working on Exhibit 1? ■ 

A. Yes. | 

Q. So you reviewed your deposition 

I 

testimony from March 12th, the second 

i 

deposition,in this case? ! 

I've read most of it since then, 

rv-1 

yes. ^j|§!#en't completely read it.j 

| 

G^ ; ¥ Do you have any additions or 
changefto j that testimony that you need to 


change 
back ii$u 



Not that I'm aware of. 


time any 



And do you have at this 
the first day of deposition from 

I 

pruary that you need to make? 

Not that I'm aware of. 

Why don't you just tell; us why it 
is than yob went ahead and did a third report 
in this case? 

I 

A. Okay. Well, in social jscience 
research in the academic world thatj I live in, 
the publication process involves a .sequence of 
what we call peer review whereby ah author 
writes a piece of research up and submits it 
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Krosnick ; 

to a journal, and the journal then [solicits 
evaluation from peers who are experts in the 
area who typically will raise questions or 
uncertainties about the work. 

And those uncertainties! or 



.are then returned to the 


author and 


— it is incumbent on the author 

I 

. , l ... 

pond to those issues by [revisiting 

i 

at were examined to test whether 

i 

hesis or correct or plausible in 
evise the paper and resubmit it to 


In this case, it seemed to me that 

l 

the profflafes actually evolved somewhat like 
that. I did a piece of research, 

submit^^^a written report, and then received 
back aRSBies of written critique of that work 
by experts' commissioned by the Defendants, as 
I understand it. 

And in those reports, they raised 
a series of issues. In addition, during my 
depositions, a series of issues were raised 
about the data, and in some cases, i I was in a 
position where I could return to t^e data and 
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Xrosnick 

j 

test whether these suppositions werje actually 

defensible, credible, plausible or not. 

i 

i 

And so I thought it would be 
helpful to conduct those analyses, which I 

i 

did. And when I did, the attorneys! 
representing Empire said that I neeked to 

descrilflfwhat I found in a written report and 

f" j 

oresentLgytJto you all, which I did.i 

Okay. So you view the expert 
reportdHcc^some of the Defendants' experts as 


|kin to a peer review of your prior 



is case? 


i 


There are aspects of thkt process 
that re se&b le a typical peer reviewj, yes. 

C|1 .. ^ And you view some of the questions 
that wepgggsisked at your deposition as 
somethill|ffllkin to a peer review of your work 
in the ; 

i 

A. Procedurally, we don't klways have 

conversations face-to-face with edijtors or 
reviewers. But in those depositions, 
questions were raised about the meaning of the 
data that I had presented. And thajt process 
identifying such issues is analogous to what 
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Krosnick j 

occurs partly during a peer review process. 

j 

Q. And this report, then, Exhibit 1, 

j 

sets forth your response to the review by 
Defendants* experts of your work? 

A. No. 

Does this response set jforth — 


are yoff saying no because it doesn’jt set forth 
responses to the review!? 


all ofl 


respon 

that w 



I didn’t think of this, 
particularly. I thoughtj 


really, as 
of this as 



ul to the process by returning to 
and testing some of these 'assertions 
estable. j 

I didn't view this as a process 


whereby^X^should consider and respdnd to all 
of thepi^mes that were raised, particularly 



lssuesrrp^t need not be addressed by data 
analysTsT”^ This is completely focused on 
revisiting the data themselves to tphe extent 

they could be helpful. '| 

\ 

Q. But you revisited the data in 

I 

order to respond to criticisms that had been 
made of your prior work by the Defendants? 

I 

A. In order to respond to! criticisms 
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Krosnick 

or questions or uncertainties that v^ere 

raised, yes. 

Q. And this Exhibit 1 is, tjhen, the 

I 

result of your revisiting of that data in 
order to respond to the Defendants' |criticism? 

A k I'm hesitating on the wojrd 
"responi^Hcecause I didn't really vi|ew it as 
respond ing^J -n that sense. 

^ I revisited the data in jorder to 
address interest in these issues. And 

having Bohejthose analyses, the attorneys said 
it0^s my responsibility in this process 
to shar^^t I came up with with yog all. 


But I did not view this hs a 



situatipjL^m which, you know, some concerns 
had serf and, therefore, I would 


had bee^ 
respond^ 
example? 


would with a journal editor, for 


Because in that case, I would 
detail every issue that’s raised and 1 I would 
address every issue that’s raised both by 
drawing on additional data analyses jand any 
other literature and any other thinking that I 

I 

might have. 
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Krosnick j 

I 

But this is not that type of 

process, as far as I understand. 

Q. Okay. But you are addressing 

l 

then, not to use the word "respond," but you 
are addressing some of the issues that were 
raised fey Defendants' expert in this new 


report pmich is Exhibit 1; is that correct? 
Aj^^j Absolutely right. j 

Qj ftJ Have you — and you did jadditional 


analysed 


some of the data that you already 


had in 5rj2ef to address some of those remarks 
b^^iefe^ants' experts; is that faiij? 

0 s Not on iy Defendants' expjerts, but 

as I ea mHa^ said, during questioning and 
depositftuT’as well. 

O ^^ Okav. As I gather your i 
descrip^^^of the process, it sounds like it 
was you^fella to do this; is that falir? 

i 

A. Do what? | 

Q. To create, to go back and address 
some of these concerns that were raijsed by 
Defendants' experts? 

A. Yes, it was. 

Q. Are you the only person who 
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Krosnick 
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contributed work product to this report? 

i 

A. Yes, I am. 

i 

Q. And you conducted then! the 

actual — for example, you run some logistic 

i 

regressions, the results of those are 
reflected in Exhibit 1, correct? 

Yes. 

i 

And you’re the one who I ran those 


regress 




That's right. 

And I assume, do you hold all the 

essed in Exhibit 1 to a reasonable 

, 1 

Scientific certainty? ! 

Yes, I do. 


Q,, ...... j Are there other issues ithat were 


raised i 
prompt 
data? be 
A. 



fendants' expert reports that have 
to go back and reanalyze your 
e just leave the questipn there. 

I would have to look atl those 


reports again to see what issues were raised. 

And you know, I can't recall 

specifically an answer to that question with 

I 

specificity. j 

Q. Okay. Have you done any other 
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V 

Krosnick 

i 

reanalysis of your data since your deposition 

on March 12th, other than the analysis 

1 

reflected in Exhibit 1? I 

I 

A. I believe — you know, I'm not 
completely sure. Anything that I did was 
turned dver^to you appended to this|report at 
There may have been some 1 additional 
t I did. I just don't remember 
the package. 

Let me give you an example, 
fhave you read his report? 

^Which of his reports? • 

|The report of his that comments 
ports. i 

I've read one of his reports which 

i 

very recent, and may have been — 


the time. 

n. 

analyse 
what wa 
Q 

DUec 
A 
Q 

upon you 

A *—■. 






I gathe: 

l j ! 

now thatyod said this, perhaps it was focused 

on mine, yes. ! 

Q. And it comments upon your 
calculation of the relative risk that you 
performed in your initial report? Do you 

remember Dr. Wecker doing that? 

A. What I remember in his report was 
an analysis, a statistical analysis: using not 
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Krosnick i 

i 

the data that I analyzed here, but some other 
data addressing what his perception!of the 
actual relative risk of contracting lung 
cancer from cigarette smoking is. 

I didn't personally do any 
analysi$<to .address that question. And that's 
why I little thrown off by yoihr 


Okay. And have you done any 
investigation since March 12th or 
ing that report from Drl Wecker to 




Dr. Wecker's report? j 

SMR. BSCHORR: Objection! 

■ No. ! 

s j 

0' Some of the Defendants ’ | experts 
reports sasaki remark about the position of your 
prior that dealt with the deposition 

survey <t?™Kfue Cross subscribers. Do you 

recall that issue? 

A. Yes. ; 


Q. 


Have you done any reanalysis of 


your previous analysis with respect to the 

I 

deposition survey in response to comments made 

i 

by Defendants' experts? 
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Krosnick 

A. No. I have continued to read 
those depositions. And as I continue to read 

i 

them, I get more information about jzhem. But 
I have not redone in any way the earlier 
analysis, no. i 

j 

^ Okay. You haven't donejany 
ions to your prior statistical 
those depositions? 


modifi 

analys 



anv.an 

at lea 

over t 



That's correct. 



And just so the record is clear, 
s, reanalysis that you did of the 

i 

has been provided to the Defendants, 

* i 

far as you know? 

Yes. I don't know what| was turned 
jyi, so I can't comment. 

? MR. BSCHORR: As far as I know, 
represent that, everything that he 
urhed over to us, we turned over to 
you. 

MR. MASSARO: That closjes the 
loop. Thank you. 

i 

Q. Do you view your SRBI sjurvey as 
having been peer reviewed at this pjoint? 

A. I think it has undergone a process 


BEST 

COPY 
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Krosnick 


very much like a peer review, yes. 

Q. In what way is it different from a 
peer review? 

A. Well, I guess we can talk about 
different sorts of peer review thatoccur in 

i 

social ^science. But let's take the;most 


bes 
cop 


common ?dne. 






involv 



In the most common one that 

J 

urnal article, publications or 


grant revie ws, the reviewers are anonymous 
from tbajboint of view of the reviewed, sort 


identit 
work. 1 



So I would not normally!know the 
of the people who are evaluating my 


(Imhf Okay. Any other differences? 

Secondly, there would not be the 
case that anyone involved in the process would 
have been under oath in providing tljie 
information that they provided, andjl don't 
know the extent to which the legal process 
considers us under oath as we do this. But 
that would be another difference. 

Yet another difference would be 
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would 

typica 




Krosnick | 

that the peer review process is typjically 
implemented by an editor or a grant review 
administrator who selects the reviewers and 
brings about the process.. 

And in this case, one might 
consider, the lawyers involved to represent the 

editorlr^ i 

- 'I 

•■VMS*** 4 ■ 

Other than those differences, I 

I 

his process very much re'sembled a 

i 

r review. 1 

At this time, do you have plans to 
rpher reanalysis of the SRBI data 
ur testimony on Monday? j 
No, I don't. 

And do you have plans to do any 
furthe^^malysis of the deposition survey 
data pj^|^ to your testimony on Monday? 

No, I don't. 

Q. No plan for any additional 
supplemental disclosure prior to Monday? 

A. No. | 

I 

| 

Q. Very good. j 

I'd just like to take a look at 
Exhibit 1. And I guess beginning at the back, 


my 
prior 
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Krosnick 

the last section, "Wording of Survey Questions 

i 

Used to Measure Perception of Risk," which 
begins on page 5. j 

A. Yes. 

Q. In that section you dispuss having 

L 

conducted Jj-ogistic regressions predicting 
quitti with a perceived risk differential? 

r 

Yes. 

Those, you had not done! those 
regres 4Tog| in your prior reports; [is that 

rec tZ-L; i 

I had not described them in prior 
iiat is correct. 




report 


regres; 


report? 



Had you done the logistjic 
prior to the prior report? 

i 

Prior to submitting the; prior 




Q. They were done since your last 

| 

deposition; is that fair? 

• i 

A. That is correct. j 

Q. The next, moving further forward 
in the document, the "Relative Risk versus the 
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Krosnick i 

Absolute Risk and the Risk Differential" on 

page 4 refers to testing whether perceptions 

j 

of relative risk, perceptions, smoker's 

i 

absolute risk or the risk differential inspire 
quitting smoking. That test is a test you've 
done siy^ce your last deposition in this case, 


correc 


the 11 
That, 

a| 

£ la 



fj That's correct. 


Q. 


I 

i 

And then there's a reference to 

[ 

rend analysis in Paragraph 11. 
jlx|, is an analysis you've done since 
deposition in this case? 

That's correct. 

And then there's two logistic 





regressions- that are referred to in 

And those are analyses that 
:ed since the last deposition in. 
jrrect? 

That's correct. | 

j 

The same, is it also trike for the 
recoding of the constituents in the|motivation 
to quit index, that is a recoding tiiat has 
been done since the last deposition!in this 

I 

case, correct? 
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Krosnick ' 

A. Yes, it is. j 

Q. And a discussion of Cronbach's 
alpha in Paragraph 7 on page 3, that analysis 
relating to Cronbach’s alpha is something 

i 

that’s been done since the last deposition in 

1 

this dase., correct? i 



last 


| Okay. That was done before the 
h.tion in this case? ! 

! I believe it was done before the 


t that X submitted was submitted. 


™ m Okay. 

fh_, And it was included ini the packet 

of materials turned over accompanying that 



report^ab^that time 


But there is no discusision of the 


Cronbae?lf s ?P alpha results in the tdxt of your 
first Nlpolrt served in January of jthis year? 

A. That’s correct. ! 

Q. And was there discussion — there 
is no discussion of that in the prior two 
depositions in this case; is that;fair? 

A. There was discussion of the issue 
that it addresses in the prior depositions. 
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Krosnick 

Q. No discussion, of the analysis that 

resulted in the statistic of .78 for current 

! 

smokers? I 

I don't remember for sure. 

And then Paragraph 6 refers to a 
y<^u ran in response to Defendants' 
riowetz' report. That’s aj test that 
e since the last deposition in 
orrect? ! 

]In a way that’s correct,; in a way 
srect. The essence of this test is 
|n my first report. It’s done here 
jferently. 

| 

"Okay. So the test and the test 

I ! 

results |tha.t we have in this report are 

differerfel^om the test results that: you had 
ior to the last deposition? 




i 


ell, no. The results are the 


performs 

a: 

same. 

i 

Q. The test is performed in a 
different way than it had been done 
previously; is that correct? 

A. That's correct. 

I 

Q. Is the same thing true for the 
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Krosnick j 

l 

I 

test referred to in Paragraph 4 and' 5 of the 

report; they're done a different wa!y than they 

! 

had been done previously? j 

A. That’s correct. 

Q. And what’s your, what about the 

analysis discussed in Paragraph 2 ojf the 

Is that something that’s dew since 


report? 

r 

your f| 




deposition in this case? 

I 

J, 


Again, the hypothesis peing tested 
there wa's'tested in my first report'. It’s 
lg |^g|d here in a slightly different way 
th^^result is the same. I 

In your first report, you didn't 
run the^p^i lysis controlling further variables 
that lected in Paragraph 2, ;did you? 

That's correct. 

i 

But you believe you addressed that 
issue in sbme other way in the first report; 
is that what you're saying? 

A. That's correct. 

Q. Now that we're back atj 

Paragraphs 2 and 3, let me ask youjif you can 
briefly describe for the record what it is you 
did, the analyses that you did that's 
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Krosnick 

reflected in Paragraphs 2 and 3. 


A. 


Okay. Well, the focus of this 


analysis is revisiting the question;of what 

i 

impact, if any, the quotes by the Surgeon 

General and employees of tobacco companies 

| 

that wei?erpad to the SRBI respondents had on 
what I nave called in the report the 


motivate 
to whic| 
smoking- 



experim 
assigne 
as they 



:o quit index* That is, ithe extent 

:rent and former smokers ■ regret 

I 

And in analyzing any true 

| 

where respondents are randomly 

different experimental conditions, 

\ 

! 

here, it’s important to control 


for differences that may occur by chance alone 
groups in terms of characteristics 



iduals not affected by the 
manipulation of interest. 

In my first report, I did that 
controlling by relying on the random 
assignment procedure. That is random 
assignment in principal should yield groups 
that are very similar. And in fact,! the 
groups were very similar as I described in my 


SPHERION DEPOSITION SERVICES 
( 212 ) 490-3430 



http://legacy.library.ucsf.e(fii[/ticK^!ctCt!|ailiO)ipBHA/.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5784 






26 


1 

2 







report 


Krosnick 


What this analysis does 1 is to take 


a small additional step to control for these 

i 

demographic differences between the four 
groups by incorporating measures of!all the 
availal&Le demographics as control variables in 

based on the same mathematics as 

I 

fn the first report that I 

| 

Okay, Are there additional 

[ 

hat you could have controlled for 
the data that you have? j 

I did not feel that there were any 

! 

bles that could legitimately be 
„at control. I believe it| is 

to control for variables; that 

i 

ffected by a manipulation itself, 
cused on demographic variables 

Okay. Let me just see , 1 make sure 

that I have it. i 

] 

There are additional variables 

i 

that you could have controlled for,; correct? 



A. 


Well, there are other variables 
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Krosnick ; 

measured in the survey. And when you say that 
I could have controlled for, I could have gone 
through the mechanical process of putting one 
of those variables in as a control variable 

when doing the statistic. So you know kind of 

i 

physicki. ly.> I could have done it, yes. 

But you didn't feel it jwas 
to control for any additional 

i 

)ther than the ones that !are 

j 

.n Paragraph 2? i 

I 

That's correct. 

I 

Did you consider controlling for 
variables other than the ones 
_n Paragraph 2? I 



appropp 

variab^ 

reflect 


No. 


The results of this is 


in Tab; 



reflected 


| the first two columns in Table 1 


which is in Exhibit 1, correct? 


A. The results described in 

1 

Paragraph 2 are in the first two columns, yes 


Q. 


And the variables are, I some of 


them are listed, they're all listed, I guess, 

in the furthest left-hand column of Table 1? 

| 

i 

A. Yes, they are. 
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Krosnick I 

j 

Q. What does it mean if a variable’s 
coefficient is significant? 

A. That means that the variable 
listed there can be used to predict jvalues of 

j 

the dependent variable, in this case the 
motivation to quit index, yielding greater 
than chince'accuracy in that prediction 
process LwEile holding constant all qf the 
itors included in the equation. 

So does it say, then, that that 

[ 

|:in part a determinant of someone's 
to quit as measured by the 
|o quit index? j 

That's true for some of (these 

i 

variablq&.-v^The three at the top of jthe list 
that aref^^f focus of this analysis jare 
suitably^fll|cribed in the terms you jused 
because they are experimentally manipulated. 

I 

So the extent there is a! 

i 

relationship between these variables; and the 
dependent variable, it can only be tjecause the 
manipulation affected the dependent [variable. 

Q. And does the size of the 
coefficient, what impact -- strike that. 
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Krosnick j 

What importance, if any,i does the 

! 

size of the coefficient have when we're 

I 

discussing these first three variables on the 
list? ! 

A. Well, the size of the coefficient 
with regret to those three variables describes 
the size of the difference between tihe 

groups being compared in terms of 
it variable. That is the 

i 

;o quit index. j 

Is it the case that the |greater 

| 

^Lcient, the greater the effect of 
_e on motivation to quit? 

Yes. | 

And the sign, whether it is 
positive of the variable, what 
IP; that have in your opinion? 

' Well, the sign, in the case of 
those three predictors, reveals thejdirection 
in which the prediction is justifies!. 

In other words, the first two 
coefficients listed at the top of the first 
column in Table 1 are both positivej. And the 
predictor variables are coded such that a 
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Krosnick 

larger number there refers to presence in the 
control or SG conditions of the experiment as 

compared to the SGTB group. And thjs dependent 

i 

variable is coded such that larger values mean 
less motivation to quit. ! 

So what that means is that in the 
SGTB g , there is more motivation to quit 
and re about smoking than there is in the 

the SG group. 

Okay. And if something leads to 
more — strike that. 

If a variable leads to |there being 
ition to quit, in your opinion, that 
fewer people would have I smoked had 
those panditi- ons been present? 

That's correct. 

So that if a variable's sign is 


positive in this analysis, it means that it 
would have the effect of causing more people 

l 

to quit smoking? 

A. I think we need to be clear on 
what "it" is in your sentence. j 

I 

Q. If a variable sign was! positive, 
that would mean that the presence of the 
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Krosnick | 

conditions reflected by that variable would 
lead to more people quitting smoking in the 

f 

real world, in your opinion? j 

A. I'm tempted to say yes -j But I'm 
concerned that may lead to misunderstanding so 


let me 



i 


absolutely clear. 

, I 

Given the way these variables are 

I 

>e positive coefficient mean that 

! 

ients who are in the SGTB^ group 
>re regret about smokingj and more 

to smoke than the resporidents in 

i 

ropp and the respondents in the 
>up, significantly so. ! 

i 

And from those differences, I 

4 \ 

infer a-^reater motivation not to smoke and, 

; i | 

thereflPt^jF a reduced likelihood of smoking in 
the | 

Q. ' And the last portion of your 

answer, from those differences what you infer, 

! 

refers to the real world? ! 

I 

A. Yes. j 

I 

Q. From those differences you infer 
that more people would have quit in the real 
world; is that fair? 
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Krosnick 
A. That's correct. 

i 

Q. And that's because the coefficient 

l 

f 

is greater for those and is significant for 
those variables as compared to other variables 
that you run? ! 

No. 

If the coefficient — strike that. 

I 

Let's look at the first I two 




condition four versus one and 


group? - x 


variabl 

conditibn.....fbur versus two? 

Okay. j 

i 

Condition four is SGTB?j 
Yes. | 

And condition one is the control 

j 

Yes . 

And two is SG, correct?] 

A ! . 1 Yes 

Q. Can you say that the fact that the 
first comparison has a coefficient .21 versus 
the fact that the second has a coefficient 
of .19 means anything about those two 
variables as compared to one another? 

MR. BSCHORR: "Mean anything”? 
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' I 

Krosnick j 

A. I’m sorry. It is a litjtle too 

! 

vaguely stated. If you want to be jmore 
specific, I’ll be happy to be a litjtle more 
clearer. 

] 

Q. Does the size of the coefficient 
have a nximp act at all on your conclusion about 
the effects of that variable on people's 
to quit? 

Yes. 

And what effect does it have? 

Well, as I described earlier, the 


motivap 



these coefficients describe the 
of differences between the 
il conditions in average jmotivation 
to quits—ee^itrolling for the remaining 
variabllP^ 

And the greater the difference, 
the greater the motivation to quit? 

A. I wouldn't say that. I mean, the 
greater the difference, the greater the 
difference in motivation to quit, j 

Q. The greater the effectjon 
motivation to quit? 

A. The greater the effect!of the 
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Krosnick 

manipulation, yes. 

Q. In Paragraph 3, the conclusion you 

| 

reached is that hearing messages i 
simultaneously from two difference sources 
would have an effect on motivation to quit; is 
that fa igg 

Yes. Not two different [sources 
:icular sources. j 

[That’s what I was getting at 

I I 

ihere is, it is important to you 

hese two particular sources, the 

) 

neral and the tobacco companies, 

i 

I 

I'm not sure what you mean by 

i ! 

'fto me. 

^■'The way your opinion is [phrased, 
you ind iblft eS that people find it especially 
persuasive to hear these messages from two 
different sources, especially when making the 

j 

statements was against material interest of 
one of the sources; do you see that? 

A. Yes, I do. | 

j 

Q. Does that indicate to you or 
due -- strike that. 
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Krosnick f 

Is it your conclusion that 
whenever people hear these sorts ofj remarks 
from two different sources, that has an effect 
on their motivation to quit that's greater 
than if they heard it from just one source? 



ELIO 





that 


’woBld 


have 
not. 


And do you have an opinion as to 
ere are other sources — .strike 


Do you have an opinion jabout 
sourcJffMher than the Surgeon General and the 
^y^actSigjoups and whether their statements 




i an effect on motivation to quit? 

^ Yes, I do. ! 

“ | 

^ Okay. What is that? 

I Well, by analogy, this 1 experiment 

|ed to represent a process that could 

Ided in the role world, but it did 


And because of the nature of. 
experimentation, it is never possible to 
incorporate in a, all of the relevant real 
world circumstances that could be present at 
the time of interest. 
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i 


1 Krosnick ! 

J 

2 So in designing this study/ I 

3 viewed messages from the Surgeon General of 
| the United States as being suitable{proxies 




kll 




and particularly desirable proxies from 

i 

messages from other credible health j 

profes^hqgals whose interest is in protecting 

public ^iieaJLth and minimizing the livelihood of 


diseas 



America. 


^ Similarly, the particular tobacco 


companies that were mentioned in the 


that cc 


comfort 
other \ 

i 

partial 




|ns used in this experiment were 
proxies for other tobacco' companies 
^instead have been used. 

*■' And so by analogy, I amj 


generalizing these results to 


ion sources besides these 


particular* tobacco companies and the Surgeon 
Generaf^rr particular, yes. | 

Q. Okay. Do you view the jSurgeon 

j 

General and the American Heart Association as 
different sources? 

A. Yes. 

Q. Do you view the Surgeon General 

j 

and the American Lung Association different 
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Krosnick 



sources ? 
A. 
Q. 


| 

Yes. 

And do you view the various 


tobacco companies as each different;sources 
from one another; is that what you're saying? 
Yes, I do. 

And do you have an opinion about 
ring messages from two tobacco 
s opposed to from one tobacco 



whethe 
compan 

company"ccu1d have an effect on motivation to 


quit? 


I think we’d have to bejspecific 
about v ^atj messages. But I think, yes, it is 
possibl e ill© r two messages from two Jiifferent 
tobaccq^coiapanies to have a different impact 
than oi^frtfhe of those messages alone. 

And do you have an opinion about 
whethei^lfet is a greater or lesserj impact? 

A. Yes. The literature in| social 


psychology would suggest that it would be a 
greater impact in general, assuming! the 
messages make the same assertion. And 
assuming that the assertion is viewed as 
credible by the audience. 
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Krosnick | 

On the other hand, if the 
assertion is viewed as not credible!, then more 

i 

! 

and more assertions may not, in fact, increase 

persuasion. ! 

| 

Q. And is the same thing true in the 

i 

flip sitljyy You said the Surgeon General and 
you meffit the American Heart Association as 

f" i 

differ^®! 


ources, correct? 

Yes. 

I Do you have an opinion about 
ring a statement from the Surgeon 
nd the American Heart Association as 
pust hearing it from the Surgeon 

Genera] lid have an effect on motivation to 

| I 

gu it? 

As I said, yes. I think it could 
feet, yes. : 




have a 



be? 


A. 


Okay. And what would the effect 


Let me clarify. Are you asking an 


effect different from if only one source 

i 

Correct. 

Okay. I just wanted to make 


were — 

Q. 

A. 
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Krosnick 

sure. 

It is possible that heating quotes 
from a second source, if viewed as credible 
can increase persuasion, yes. 

Q. And when you say it’s possible, do 


you ha^aan expert opinion as to whether 


that's! case or not? 



More 


^ That is my expert opinion. 

Let's look at Table 1 again. 

I 

for my [use^than yours, I suspect. j 

The analysis that you’re referring 
^ > n iga graphs 1 and 2, you ran on the SGTB 
group y era us each of the other threje groups? 
is that j£®&$rect? i 






Yes. I think that’s a fair way to 


put it J 


CrFlrM And you ran it — okay.j 

And did you run it on any other 

groups? 

j 

A. Sorry. The phrasing of the 

question is catching me up here. ! 

1 

Q. Did you compare any other groups 
in your analysis that's described in 

i 

Paragraphs 1 and 2 -- 2 and 3? 
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2 A. Well, in Paragraphs 2 and 3, my 

3 analysis focuses on comparing the SGTB group 
to each of the other three groups, and only 
those other three groups. 

Q. So you didn’t run it on SG versus 



23 

24 

25 


Not in those columns ofj 


numbers. 


Did you run it on SGTB lin any 
is? Strike that. ! 

Did you run it on SG ve;rsus TB on 

i 

cplumns? | 

No. ! 

I 

And those columns you didn't run 
versus TB, correct? 

In which columns? 

Qrr^ In the first three. 

A : . The first three columns, no, there 

is no comparison between control and TB, 

! 

that's correct. 1 

1 

Q. But later on you did run a 
comparison between control and TB, jcorrect? 

I 

A. Oh, I'm sorry. My mistake. 

When you're saying thejfirst 
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Krosnick 

I 

three, you mean the first three columns of 
number? 

Q. The first three rows is[probably a 

better way to describe it, j 

i 

MR. BSCHORR: First three rows. 

I 

, Excuse me. Let's start j this 

, "t i 

In^the first three rows, there is only 

of the SGTB group to each of the 

j 

groups and there is no other 
to any of the other groups 

And nowhere in Table 1 o_s there a 

I ! 

of SG versus TB; is that; correct? 

Correct. j 

But there is a comparison later on 

| 

versus TB, correct? ; 

Yes, it is. | 

And that’s not significant? 

That's correct. j 

j 

And all of these analyses — 



of con 


A. 

Q. 


strike that. j 

I 

In any of these analyses, did you 
run them using only data for current smokers? 
A. No. 
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Krosnick 

I 

Q. Let's look at Paragraph:5 of the 
opinion of Exhibit 1. 

A. Okay. 

j 

Q. In Paragraphs 4 and 5, you T re 


essentially testing the hypothesis that 
hearing a greater number of statements is what 


drives 

I 

rather[ 

summar 



of quote' 


any ef 
from va 



ie ! motivation to quit differences 

i 

the source; is that a fair 


No. j 

i 

I 

Okay. Why don ’ t you giive me a 
ry? j 

i 

I am testing simply whether volume 

i 


Lffects motivation to quijt. 

Are you testing whether; there is 
at all from volume of quotes or 
:r, instead, volume of quotes is the 
only afFgFt? J 

A. I'm testing whether volume has any 


effect. I 

Q. And do you have a conclusion about 
whether volume has any effect? 

A. Yes, I do. 

I 

I 

Q. What is that conclusion? 

j 

I 
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1 Krosnick I 

2 A. That it does not in and of itself. 

3 Q. So merely hearing the same source 

j 

f \4 make a statement over and over again, in your 


opinion, has no effect on motivation to quit? 

A. In this experiment, hearing three 
quotesNiich not increase motivation |to quit as 
comparid to people who heard no quotes. 

^ ~ I 

% | | 

That' s ystebonclusion. 


And what — do you draw any 
conclusior^ about, you just stated dhe results 
q±. v/our^hxpe riment. 1 





Do the results of your Iexperiment 
lead v ou.,td draw any conclusions about the 
real wori^ in that respect? 

N o. 1 


about 


So do you have an opinion then 
ler hearing the same statement from 


the same'source different number of times 
would have an effect on a person's smoking 
pattern? I 


Q. What is that opinion? j 
A. Well, there is large literature on 
what’s called message repetition in 


SPHER10N DEPOSITION SERVICES 

(212)490-3430 j 


cop^L 


http://legacy.library.ucsf.eSlffittiDl%cl[QfiM^Wpy(slfv.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5802 



44 


BBS'! 

copy 







Krosnick ; 

I 

psychology, when the message comes from the 
same source over and over again. 

And repeated exposure to a message 
has been shown to enhance persuasion — excuse 

i 

me, to enhance persuasion up to a certain 
point, ha nd^ then after, you might say too many 
exposures it actually decreases persuasion as 
rule. ! 


a gene 



However, that general pattern is 

by an interaction determined by a 

.t 

iables. The extent to which the 
s processed carefully and [the 


the arguments in the mejssage are 
determinants of the nature of that 

p ITOCSS | 

So in other words, it is possible 
that rlngplfted exposure to the same message can 
initiallyincrease persuasion, or it can 

I 

initially decrease persuasion. 

So my goal in doing this 
comparison here was to say very narrowly with 
regard to these particular sourcesjand these 

i 

particular messages, exposed underjthese 
particular circumstances, does merely hearing 
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Krosnick 

these quotes in a certain volume erjhance 
motivation to quit as compared to people who 
have not heard those quotes. 

And therefore, the conclusion I 
draw is that in this context, mere jvolume does 
not pti&duqe differences in motivation to quit, 
thereh^’reducing the likelihood that any other 

rvl ! 

differi pa>Bfl| s are attributable to mere volume. 

The answer you just gaye began 
with aHdesbription of what the literature 


exposure to the same message from 
source over and over again, correct? 

i 

Yes. 





And that opinion then was based on 


I 


your 

liter 


: Q- 


al background familiarity with the 
as a whole? j 

That's correct. j 

It was not based on this 

i 

experiment that you've run in this|case? 

A. That’s correct. j 

i 

Q. Do you have any opinion in this 

case based on the experiment that you've run 

i 

in this case about that question? 

i 

A. Sorry. You have to repeat the 


I 
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Krosnick 

question. 

Q. Which is whether hearing the same 

| 

statement over and over again from the same 

source would have an impact on people’s 

j 

motivation to quit? 

Again, I'm having trouble with the 
As compared to what? I guess? 
re impact? I guess I’m not clear. 
Do you have an opinion based on 
int that you've run in tliis case, 
r a person’s motivationjto quit 


I 
1 

easels in proportion to the number of times 



re a statement from the same 


source? 


Yes, I have an opinion. 

" And what is that opinion? 



“It is that it depends oh the 

_J ; 

message' and' it depends on the source and it 

j 

depends on the circumstance. I 

Q. Let’s assume that the message and 
the source are the same and the only question, 
the only thing that differs is the number of 
times that the source makes the statement. 

Do you have an opinion about 


BEST 

COPY 


SPHERION DEPOSITION SERVICES 
( 212 ) 490-3430 


http://legacy.library.ucsf.e^ii/ticK^!ctfl!|ail)0)ipBHA/.industrydocuments. ucsf.edu/docs/qyhl0001 


52434 5805 




47 


COP 
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Krosnick [ 

whether that has an effect on someone’s 
motivation to quit? 

A. Yes. As I just said, it depends 
on what the source is and what the message 
is. So just saying they're held constant, I 


undersf 


Lthat. But I'm saying it 


who 


depends on 


exict^ the source is and what exactly the 


messaate^d and what exactly the context is. 

Okay. So you have different 
opinio ^s^ah out that question based pn your 

|in this case depending on who the 

a i 



I'm sorry. Maybe I lost the 
questi o^^ - But I was answering generally not 
about experiment. I was answering about 

the re|i^^5rld. I thought that's wjhat you 
asked. j 

I'm asking: Do you have an 
opinion in this case based on this experiment 
that you've run in this case, about whether 
hearing the same statement from the same 
source over and over again increases a 
person's motivation to quit? 

! 

A. Yes. I have an opinion and the 


SPHERION DEPOSITION SERVICES 
(212) 490-3431) 


http://legacy.library.ucsf.e(fii[/ticK^!ctfl!|ail)0)ipBlfA/.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5806 





48 


Krosnick 

opinion is that it depends upon what else is 
going on at the time and who the sources are 
and what they're saying, as I've said. 

Q. So if it depends in part at least 

i 

on who the sources are — 

Yes. 

— two different sources involved 



iperiment are the Surgeon) General and 

to companies, correct? j 

l 

Yes. ! 

And do you believe then that 
|et if%oi js statements from the Su'rgeon 
Genera^^ve a different effect on motivation 
to guit^^an repetitious statementjs from the 

tobacc^o4^ an i es ? j 

Repetitious statements.? You mean 
he same statement? Just to be 




Q. 

A. 


Yes 


You don't mean that perjoratively? 



Q. 

No, not at all. 

1 

i 

I 

[ 

23 

A. 

Okay. Okay. Let 

! 

me see if I can 

24 

regroup and 

clarify what' I -- 

to be helpful 

25 

here. 
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1 Krosnick 

2 The purpose of the comparison of 

3 the control condition to the SG condition and 

4 the TB condition were to assess whether under 

0 . '! 

"5 these circumstances, presenting these 

particular quotes together all three in a row 
^ from eihAer of those two sources, in and of 






from ei 
itself,? 
for peq 


assert: 


heightens the salience of this issue 
Jied and heightens the salience of 
%^frora health risks from smoking at 




the t.ii te ^th aL the respondents are answering 
rn^ t~ ~l o n s * 


^ Correct. j 

1 I 

| That's an assertion that was made 

' I 

^expert Mathiowetz. 

{ 

, So the purpose of this comparison 
fss that issue. In this jcontext. 


by defer 


is to ^fflmss that issue. In this jcontext, 
hearing ^ee quotes from one sourqe when 
those thred quotes were very highly publicized 

previously, did not significantly alter 

i 

motivation to quit. I 

I draw no more general !conclusions 
from that other than in .this context, that 
presentation of information did not alter 
motivation to quit. And the only conclusion 
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Krosnick 

i 

in this context that I draw that's jof value 

i 

from that finding is that the differences 

i 

observed between the control group land the SG 
group on the one hand and the SGTB jgroup on 
the other hand are not due simply to the 


mcrea 


the si 1 set — excuse me, the set of six 


presen 

what y| 
Lskb 



volume of quotes represented by 


>ur 


o the SGTB respondents. 

And I believe I may understand 

i 

osition is, Mr. Krosnick, but let 



about 



Great. Okay. S 

i 

Do you draw any conclusion at all 

j 

i.er hearing seven statements from 
the Su£ge©ji General would lead to greater 
motivajiSMP to quit than hearing three 
stateminp^from the Surgeon General? 

A. It depends on what the statements 
are, what the context is in which they're 
heard and so on, as I've said earlier. 


Q. 


So you believe you can;draw no 


general conclusion about that without knowing 
more specifics about the context? I 


A. 


Right. From this result, yes 
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Krosnick 

That's what you're asking about? 


Yes. 


Great. 


Q. All of this is in the context from 

I 

the result that's discussed in Paragraph 4 and 


five 



tobao 
you d 



|is report. j 

5 Great. Okay. 

^ I 

| And is the same thing true for 
Wpany statements. That you have no, 
^o conclusion from the analysis that 

^ i 

| that's reflected in this report 


•ut prettier hearing seven statements from 


tobacc| 
effect 
three L 



gmpanies would have had ajgreater 
^motivation to quit than hearing 


three ifSba^ements from tobacco companies? 

I cannot draw any conclusion about 
that f^PIfflthese data, yes, that’s 'correct. 

Let me just add one footnote just 
to make sure that we're not misunderstanding 
something here. All of this discussion that 
we've had so far focuses on repeated exposure 

I 

for a single recipient. Okay? Ijjust want to 
make that clear. . 

Q. Meaning a single smoker? 
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Krosnick 

A. Yes. 

Q. And the conclusion thatjyou do 

draw is that merely hearing a greater number 
of — strike that. 

The conclusion that you do draw is 


that me 


hearing three statements as 


opposed zero does not have an effect on 
motivatlM^to quit? 

The conclusion that I draw is that 

I 

eriment, hearing three statements 
le source did not alter motivation 



And that’s controlling for all 
itial differences between! the 
situat£©f*'K is that correct? Let me rephrase 
that. I 

bsssssss 

1 Okay. 



All you’re testing fords whether 

i 

an increased number of statements from that 

I 

source has an effect on motivation jto quit? 

A. Not exactly an increased number. 
I’m simply testing whether any — these tests 

I 

are assessing whether hearing three quotes as 
compared to zero leads to an increase in 
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Krosnick 

motivation to quit. 

I 

Q. So let’s look after Paragraph 5 

i 

previously. The fact that there is! 
nonsignificant differences between the control 
group and the SG group tells you that there 
are no ,fects on motivation to quip from the 

differ© xposures of those two grjoups? 

I would almost phrase ijt that 

i 

d say that there is no jeffect of 

i 

three quotes on motivation to 

i 

I 

I 

So that when there’s a ! 

i 

i 

nt difference between the groups, 
ion is that hearing the different 

^reflected in those two groups does 

I 

effect on motivation toj quit? 
You're right. Let me bje clear. 
Technically speaking when we do statistical 
significance tests, we are testing whether we 
can reject what's called the null hypothesis. 
The null hypothesis in this case would say 
hearing three quotes produces no change on 
average in motivation to quit. 

In doing the test I’m qaying, with 
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Krosnick 

what confidence can I reject that hypothesis? 

And the results that come out of 
these tests indicate that I cannot have enough 

confidence based on conventional standards in 

! 

the profession to reject. Therefore, I 


conclude, I .cannot 


because I cannot conclude 

i 


that itPaia have an impact, I'm forced to 


concluc 


did not have an impact.j 

i 

So whenever there are I 


re 

ie 

« 

J 

quit b 



nonsignificant differences between two groups, 
he position of not beingJable to 
there is an increased motivation to 
n those two groups? ! 

That's correct. 

And can you affirmatively opine 
is no increased motivation to quit 
se two groups? 



that tl 
betweenP 5 

J 1 

0. 


In this experiment, yesj. 

! 

And that's true whenever there is 


a nonsignificant difference between the two 


groups? 


A. 


Whenever there is a nonsignificant 


difference in a context in which you have 
confidence that your significance tpsting is 
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Krosnick ; 

i 

effectively done. 

Q. Okay. And the comparisons that 
you've drawn in this experiment are;all 

i 

comparisons in which you have confidence that 
that's been done properly; is that fair? 

That's correct. 

The analysis that's reflected in 
4 and 5. Again, you did' not run 
is on only people who were smokers; 
r? 

That is correct. • 

Can you describe for me| then 
^'s move on to Paragraph ' 6 . 

This is a test that you! ran in 



Paragr 
that a 
is tha 



what -- 



respons^JtQ an issue raised by Processor 
Mathioviis^s^ correct? 



Yes. ! 

And what's the result of the test? 
A. I tested whether the effects of 

the manipulation were significantly; different 

! 

among current smokers than they were among 
former smokers. And I found that tlhey were 
not. I 


25 Q. Okay. But you didn't run the 
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1 Krosnick 

i 

2 test — you didn’t do that in the following 

3 manner, you did not run the test for current 

j 

Y' <4 smokers and then run it for former jsmokers and 

compare the two results; is that f&ir? 

it < i 

A. Well, this analysis essjentially 

L 

does th&t. I mean, it is essentially 


comparing the two groups. j 

I 

! "T".J It is a more powerful version of I 


think whggngl'ou may be implying, where you 


simply ifmnrbne regression with half] of the 
data an^5^^her regression with another half 





■ ^This analysis essentially is 
comparing/g^tose two groups directly|in a 
simult ahedul analysis. j 



all of tj! 
smokers/ 


his analysis runs a regression on 


lata, current smokers and former 


>ined, correct? 


Correct. 


best 

COPY 



Q. And then you make some comparisons 
based on — between former smokers and current 

i 

smokers based on having run the regression on 
all of the people together, correct? 

A. Well, I don’t make the ; 
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Krosnick 

comparisons. The statistical modeljmakes the 
comparison. 

Q. Fair enough. 

A. Whereas — 

Q. Is that the- only modification you 

have? Hki other words, you agree other than it 
is the licidJl that makes the statistical 
compare 

Yes. I think the model!you are 
is the one where I actually have 
comparison. Whereas in this 

i 

the statistical program does it as a 
exercise. 

You could have run the regression 
rent smokers and run the j regression 
er smokers and then compared the 

« I 

i 

Yes. | 

i 

Q. But instead you ran it this way 
where current smokers and former smpkers are 

i 

together in the regression? 1 

I 

A. That's correct. Because that's 

| 

the more powerful, more proper, very much 
standard practice approach in our literature. 
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Krosnick : 

Q. You described what the Lest was. 
What was the result of the test that’s 
described in Paragraph. 6 ? 

A. As I said a moment ago,! I did not 
find any significant differences in! the 
effectfe'%gh the manipulations between current 
and foorier smokers. j 



ask yo 
the la 




possibi 


I may simply — I actually have to 

i 

that's in fact what is stated in 

I 

rase of Paragraph 6. 


J Yes, it is. Just as I explained 


arlier. 



So you can't reject the 


that experiment effects were 


differ^at^in the two groups' 


That's correct. 




So it may be true thatj the 
experiment'''effects were different in the two 


groups' 


It is very, very unlikely is what 


it comes down to 


But you can’t reject that 


possibility? 


Yeah. We're using statistical 
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Krosnick 

terminology. Let’s be clear. In everyday 

! 

language, ves, I do not believe on 'the basis 
of this evidence, that the effect was 
different in those two groups. 

Q. Paragraph 7 refers to a slightly 
differbn tt est of the same proposition; is 


No. 


The Cronbach's alpha is the same 



as the^test described in Paragraph 


6 ? 


alpha i 


Cronba 

run? 



No. It is a completely different 

I 

I 

! 

Let’s talk about the Cronbach’s 
ragraph 7. 

i 

First of all, have youjused 
alpha in other analysesjthat you've 



Yes. 

Q. Can you give me one example? 

A. We ran Cronbach's alphd when we 

I 

were doing the very first work on cigarette 
smoking that I did as a student at Harvard. 

Q. Is that the — and the results 
are reflected in published surveys that we 
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Krosnick ; 

have, published articles? 

A, Oh, I don't remember. 

Q. What is the Cronbach's !alpha 

testing in this case? ! 

A. It’s essentially looking at the 

strength of relationship between thje four 

constituents in the motivation to quit index, 
y ^ : 

And your conclusion is jwhat? 

That all four of these measures 

appear^W^J both on face validity grounds and 

imtermES this statistical test, tap a 

i 

Gliderlying psychological construct 
which LJhaiT’e labeled "motivation toj quit.” 

And when did you first do the 
Cronba^h,ls^ alpha analysis on these [four 
concepts? 

Well, some time before I submitted 
my first report. 


Q. Were there other concepts which 

I 

you contemplated using and which you rejected 
as a result of running Cronbach's alpha on 


them? 


A. No. | 

Q. It just so happens that! the first 
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Krosnick 


6 ! 



four that you picked happened to satisfy the 
criteria you needed them to satisfy? 

A. These are all four thatjI could 

; 

have picked. 

Q. But you haven't, you didn't 



question about the coding of the response 
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Krosnick 

categories for these items. j 

And despite the fact that the 
coding approach that I used in my first 
report's analysis was very, very standard in 
our field, quite commonly done and widely 
recogn:t%pd ,to be robust to the review, I 
though#"!tjwould be helpful in this[context to 
take s [sly the issue that Professor 

*sed about people's interpretation 

| I 

Irases, draw on this veryjlarge 

% 

(that I had already reviewed, and 

i j 

^ewhat different technique to analyze 
ie that is not particularly 
the field yet, but one till at is 
attenti#&™to the issues that he raised. 

And your opinion is that people's 

percep *bf those phrases has been 

consistent over time first, correct? 

A. Of -- yes. | 

I 

Q. And that people's perception of 

i 

those phrases is relatively consistent over 
different people, correct? j 

A. Yes. 

Q. You indicate in the last sentence 
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Krosnick j 

I 

of Paragraph 8 that the studies — I take it 
those are the studies referred to in chapter 
six of your article, correct? 

A. Of my forthcoming book, iyes. 

Q. Of your book. "These studies 
suggesthfhat the perceived spacing of the 
responslPoptions offered in the SRBI survey 
arted from equality to small 


[ 


may hav| 

degrees* ib you see that? 

A' ^ Yes. 

Q J So to what degree did they depart 



I did no measurements in this 

j. 

rder to assess that directly. I 
measurements from these prior 
rder to approximate what tiay have 

i 

this case. j 

Okay. Do you know — by depart 

j 

from the equality, you mean that the 

i 

difference between -- strike that? 

i 

MR. BSCHORR: Are you shying 
equality or equality? I think you are 
saying equality. I 

MR. MASSARO: Equality.! 
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Krosnick 

MR. BSCHORR: But I wasn’t sure it 

I 

was being captured. Was it? [ 

i 

Q. Let’s just take one example. 

One of the questions asked whether 

people have "a great deal" of regret, "quite a 

i 

ret, regretted "somewhat" or regretted 


Yes. 

And you assign those in! your first 
umbers one, two, three, [four. 



23 

24 

25 


I think so, yes. 

You're saying in this last 

shat it may be that the difference 

',a great deal" and "quite d bit" is 
5 i 

fy the same as the difference between 

| . * 

5rt" and "somewhat," is that — 

! 

That's correct. 

Q. Do you know what the relative 
differences in those terms is? 

A. Well, as I said, drawing on the 
research that I reviewed in detailiin the book 
chapter, I can make an assessment of what 
those interpretations may well havp been in 
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Krosnick i 

the minds of the SRBI respondents. And it is 
those numbers that I use in this analysis and 
that appear in the printouts that I ^forwarded 
on, which I hope made it to you. 

Q. Am I correct that in youjr book, 

i 

you sc^l^p these terms on a one to a hundred 

scale, Por zero to 100 scale? j 

r~ 

Yes. j 

What would you assign "a great 
deal" c scale of zero to 100? 

I 

MR. BSCHORR: Objectionj 

i 

I’d be happy to go lookjat the 
book c! jr and pull the numbers out for you 


if you 
memori 



I don’t have all those numbers 

i 


So you can’t do it withput looking 
at the chapter? j 

Or the printout that you have. 

f 

Q. But you can’t — just the two of 
us sitting here right now, you can't do it on 
your own; is that fair? j 

A. I can't tell you what number I 

j 

took from the book chapter and then put into 
these analyses, that's correct. 


I 
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Krosnick 


Q. Do you have an estimate of what "a 
great deal" is on a scale of zero to a 

hundred? ! 

A. Let’s be clear. You’re asking me 

about how I coded it in rny analysis lor what? 

j 

<K X j Well, let's stick firstjwith how 

you coUtd it in your analysis. j 

1 I 

g Do you have an estimatejas to how 

you woi lave coded it on a scale of one to 

100, "<? sat deal"? 

"A great deal" was quoted as a 


j What about in your rescaled 
hat was it coded as? j 
A-." I’m sorry. I thought that’s what 



analys 




^king about. I’m sorry. Repeat 

i 

Ire time. j 

So on your rescaled analysis, you 
quoted "a great deal" as a hundred? 

A. I guess now we have to (qualify 

I 

what you mean by "rescaled." 1 

Q, The analysis that’s reflected in 

this new report, which is Exhibit 1J. 

! 

MR. BSCHORR: You’re saying 
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Krosnick 

rescale from the linear one to five — 

i 

I 

one to four; is that what we’re talking 
about? 

MR. MASSARO: One to four. 

A. I think now we are getting very 

confused- Because the analysis is jail based 

i I 

on a fj ioint scale. You are saying four 

|, j 

and I vj filling to go with that aj minute 

ow I'm concerned that you may not 

i 

nding this correctly. ! 

So there are five levels to these 

i 

each one of them, and they are 


ago. 
be und 



built fromltwo ingredients each in three out 

j 

cases. | 

So maybe we need to go back. I 
careful so I don’t mislead you in 
llaybe we ought to go back land start 

ese question sequence, soi I can be 

I 

If you had to assign a number 

! 

between zero and a hundred to the term "a 
great deal," what number would you assign to 
it? j 

MR. BSCHORR: Objection. 
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Krosnick , 

A. For what purpose? j 

Q. For purposes of rescaling your 

motivation to quit index along the lines that 

were done in Exhibit 1. ; 

A. Okay. Let me answer that. I 

think can do that. j 

In doing this analysis,|two stages 

I 

.ented. First stage involved 

. I 

the studies cataloged in! my book 
ich presented a series of phrases 
tjime to respondents and asked them to 
the meanings of those phrajses by 
eitlierfjSirpcting a number between zero and a 

drawing a slice of a pie or in some 
representing the quantity that each 

irases represented to thejm, in 

I 

ronsidered one at a time/ 

Now, I think in those studies, the 
average result for "a great deal" may have 
been about 69 or 70. j 

Now -- 

Q. I think by the way, you may not — 

i 

that really is the answer to my question. 

A. Excellent. Okay. Good. 
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Krosnick 

Q. If you want to — 

A. I’m not assigning number. 

Q. If you feel the need tojclarify it 

I 

further, you may continue. But that's the 

j 

question I'm getting at. | 

! 

; Just to fully answer your 

I i 

let me make sure, so you’re sure and 
at we both understand each other. 
That the rest of the process I 
asked me about then involves 

I 

ng those numbers to spread fully 

( i 

e response dimension. 

The reason being that when you 


quest! 
I'm su 

though 

>ss 





se like "a great deal" evaluated in 


take a 
isolat 
survey| 
messag 


and place it in a sequence in a 
tion, then you send an additional 
?respondents about the intended 
meanin<|~tofn that verbal phrase, that! this 
rating scale that you're offering ip intended 
to spread across the dimension. 

And Alan Parducci's work in 
particular is work that I mentioned, in my 

l 

report, I believe, as documenting that process 
that people go through in interpreting the 
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Krosnick 

intended meanings of points on rating scales. 

| 

So it is for that reason, that the 

i 

69 or 70 is then rescaled to be a value of 100 

| 

in this analysis that I've done. 

Q. I got you. Okay. So let's do, 
let's cio,.bQth numbers then for each !of the 
four phmases. 

ir 1 

? **885*" % l 

kAd First for "a great deal" you would 
fe meaning, the numeric term 



it at the initial level 


would be 


would 
uncovere 


ly 69, to the best of your memory? 
I'd almost phrase it that way. I 


he average of studies that I 
hat quantified that termj was in 
about tpiat^range, yes. j 

So it was about 69 on a | scale of 
zero tc^lp^iundred? j 

A. Yeah. I can't guarantee this. 

You know, there are hundreds of numbers on 
those tables and I don't have them memorized. 


l 


Q. Okay. Fair enough. 

And what would it be oni a scale of 

j 

zero to 100 "quite a bit"? 

A. I really am hesitating to offer 
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I 

these numbers. If you want to tell!me what 
they are. I'm happy to respond. Bilt I'm also 
happy to look at the book chapter. , I don't 
think I can accomplish much by guessing 
numbers. 

You don't feel comfortalple 
estimatung^that without looking at the book 
chapte] 

Yeah, I don't. That's right. I 

i 

I 

to give you answer — let me just 

! 



Is the same-true for "somewhat" 
.ittle"? ! 

j 

I would like to answer you 
precisesly—and I would be guessing. ! I don't 
want ta^^ss. | 

Can you give a range? | 

For in. 

"Quite a bit.". 


I 


About a 50. 


A'. 

Q. 

A. 

Q. 

'somewhat"? 

A. About 25. j 

Q. And a range for "a little"? 


And can you give a range for 
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A. About 12. i 

Q. And when you rescaled them, you 

i 

rescaled them to what? 

A. If you want to give meja 

calculator, I'm happy to do a calculation 
based b p^np inber use give me. I’m ijore than 
be helpful, but memorizing^ this is 

ng that I did to help you in this 

I 

l 

I 

That's fine. Your chapter also 

j 

ertainty levels and adjectives used 
certainty levels by respondents, 

I 

i 

That's not a term that I used. 

I 

Okay. Probability levels? 

There is information there on 

i 

assessf^^ of probability, yes. j 

And do you know whether |the 

average of the studies showed a higher 

i 

i 

probability value or close to certain as 

j 

opposed to almost certain? j 

A. No, I don't recall. j 

Q. Do you know whether it ajssigned an 
average, higher average to "close to' certain” 
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Krosnick 

as opposed to "quite certain"? 

A. I don't recall. 

Q. What about "close to certain" as 

opposed to "very probable"? : 

A. I don’t recall specifically. 

Do you think the average person, 
if conMonted with a choice between! "close to 

F“ "F ! 

certaiA^a^d "quite certain," which do you 

which do you personally 'believe — 


think 

strike 


j>er 
certai 




I'm going to ask you toj assign a 
zero to a hundred for "clbse to 

l 

l 


J. 




MR. BSCHORR: Objectio 


You're asking me how do I 


personc 


! 



interpret that term? 

£ 

Yes. 

And you want to define ithe scale? 
Q. Zero to a hundred. 

A. What are the points being? 

j 

Q. Where zero is "if least certain," 

i 

one "could possibly be," and a hundred is the 
most certain one can possibly be. j 

A. Okay. Thank you. And|your 
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Krosnick j 

question once again was for what phrase? 
Q. "Close to certain." 

MR. BSCHORR: Objection. 

94. 


A. 

Q- 


What about "quite certain"? 


MR. BSCHORR: 
78. 


Obj ection. 


probabi 




A couple more. What about "very 


MR. BSCHORR: Objection. 

I 

I’m sorry. What was the last one 


tin 



it, I said 78 to? j 

^ 78 you had "quite certain." 

"Quite certain, " sorry,| my 

-i ; 

mi s t a 

|jP^ Now the — are you wanting to 
amend answer? | 

A. Yeah, let me just think for a 
second. 

Let me say 85 for "quite 

i 

certain." What was your next one?j 

Q. "Quite certain" you would say 85 
The next one is "very probable." 

MR. BSCHORR: Objection. 
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Q. 


Krosnick ! 

I'll say about 85. 

"Almost certain"? 

MR. BSCHORR: Objection: 

95. | 

And the last one "highly 

i 

! 

• ) 

MR. BSCHORR: Objection. 

i 

90. ; 

I 

Let's turn to page 4 of!the 


gFirst, could you describe for me 

\e of the analyses that are discussed 
1 ! i 

is 10 through 12 in the report? 

>Yeah. These analyses are inspired 

I . I . . 

by a raised by Professor Viscusi m 

his most^^€ent report in which he made 
assertiJffiPljbout whether Americans'! 
perceptions "of relative risk or their 
perceptions of what I call the risk 
differential might be more relevant:to 

i 

people's decision about smoking or not. 

In addition, if I understood 
correctly, Attorney Williams, who asked me 
questions in this room last time around, I 
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Krosnick 

believe, if I understood what he was asking, 

i 

was asking about absolute risk levels. 

And so putting together'his 

j 

questions with Professor Viscusi’s report 
suggested a worthwhile comparison of these 


three 


;rent ways of measuring people's 


perception of the risk of smoking. 



Okay. And were you hoping to 
elusion about which of those three 

i 

i 

etter predictor of quitting 


about w. 


No. j 

Did you reach any concljusions 
of those three ways is ja better 
predicp©^>--pf people quitting smokiiig? 

AfpilP yes. 

And what’s that conclusion? 

A. That relative risk is a better 
predictor than absolute risk or the risk 

j 

differential. 

I 

Q. When you say you weren’t hoping to 
reach a conclusion, what led you to do the 
analysis if you weren't hoping to reach a 

j 

conclusion about that issue? 
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Krosnick j 

A. I wasn’t hoping to identified one 
as better than the others. I was sjimply 
taking seriously the questions that| had been 

f 

raised and looking at the data to see if they 
could be informative about the extent to which 

d or did not use each ojf these 

! 

s of representing the risk of 

making their own decisions about 

| 

ontinue smoking or to qjuit. 
jjBut going into it, you believed 
this test would help you reach a 

i 

>n that subject? 

(Yes . 

Okay. Can you briefly [describe 
what the—t^t you ran in Paragraph jll is? 

Okay. 

Strike that. 

First of all, you ran two 
different types of tests, correct? 

A. Well, I did two analyses; one that 
sets the stage for a second. The second one 
building on the first one. 

Q. And what's the first one? 

A. Well, I simply looked alt the 
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Krosnick 

relationship of each of these risk measures to 
actual quitting behavior. 

And to do so, what I wanted to do 
was to explore how the proportion of quitters 
varies with perceived risk. So I divided the 


sample ht 


six groups of equal size to allow 


l 





for equal^precision at estimating this 
jat each point along the j 
n r and computed the percentage of 

i 

people[in each of those six qroups who had 

i it SHtS&HOMfiCST *■ I 

si&Sste^g. I did that: for each of the 
;e *fT$k .measures. 

i 

And the fact that there' is a 
linear ^pifid for one measure but not for 
anothei^-^strike that. 

Does the fact that there’s a 
linear jNSFIlid for one measure as opposed to 

another lead you to draw any conclusions? 

i 

A. Yes. | 

i 

Q. What is your conclusion if there 
is a linear trend for a measure? 

! 

A. Well, in this particular case, if 

j 

people are using a particular perception of 

risk to decide whether or not to quit smoking, 
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l 

then one would expect a monotonic rjelationship 
such that increased perceived risk would be 
associated with increased quitting behavior. 

Now, it doesn't have to' be a 
linear relationship, per se. But a! linear 
test d£ Pen is a simple and efficient way to 

test €r a monotonic relationship. 

\ 1 .) 

Now, m this case, seeing a 

!t linear relationship in [one case 


signi 


and not seeing a significant linear 

\ f 

|ip in another suggests that the 
r,iable results are not consistent 


idea that people use that in deciding 




smoke or not. 


.This is just to be a little more 


cone re! 


in the 



You did see a linear rjelationship 
of relative risk, corrfect? 

f 

Yes. , 

And you did not see a jlinear 
relationship in the case of the other two risk 
measures? 

A. No, that's not correct. 

Q. Okay. What is correct? 
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A. 


Krosnick j 

Well, in the case of the other two 


measures, the risk differential did; in fact, 

i 

reveal a statistically significant linear 
trend but one that was notably weaker than the 

linear trend that existed for relative risk. 

| 

In the third case, absolute risk 
inear trend was not statistically 


And because the linear trend in 
;k was not statistically; 

i 

while the linear trend for 
sk was statistically significant, 

I 

.one supports your conclusion that 
>k is a more important determinant 
of smokjUig^behavior than absolute r|sk? 

Ap*# Yes. Although we have to be 
careful^^i. Because these three measures of 
risk ar^sorrelated with each other!. 

And that's why I did the 
supplementary analysis to address the question 
you’re raising more directly and usefully, I 

j 

think, than can be done alone by looking at 
these relationships. j 

Q. If you only had the linear 
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Krosnick 

i 

analysis that you did, would you say that 
that -- would you be able to have an expert 

I 

opinion as to whether relative risk; or 


absolute risk were more important predictors 
of quitting behavior? j 




I just want to make surje. 

I would conclude from Iboking at 

I 

elatrve risk was more prevalently 
pie to decide whether or not to 

l 

absolute risk if — excuse me. 
Yes, tbsolute risk. And also jthat 
relate 


r sk was more prevalently used than 
the rijkldifferential. j 

Q. Okay. And the reason you would- 
conclude that is because the linear trend is 

i 

statistically significant in the case of 
relative risk and is not statistically 
significant in the case of absolute risk? 


A. 


That coupled with the data. There 


is no hint when you look at these six numbers 
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Krosnick j 

of a consistent monotonic trend of increasing 
quitting rates with increased perceived in 


absolute risk. 


By "these numbers," you meant the 


k 6 numbers for absolute risk, correct? 


Yes, I did. 



Q r - 

i "X"' 

that yolP^ 


And then what’s the second test 


In Paragraph 12 you're jasking 


about? 




to pred| 
three o^j 
said, tl 


^ Correct. | 

^ So that analysis is the|n intended 

^guit rates simultaneousiy using all 

fese risk measures. Because as I 
1 ! 

*vare correlated with each other to 


some ex^tlllTt and variance. That appearance, to 
be attx^^^able to one could, in fact, be 
attributable to another instead. 

So this analysis says folding 
constant each of these, is there any 

r 

additional variance explained in quitting rate 

by the one. ; 

' I 

This analysis comes really much 
directly out of conversations that, I had with 
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Krosnick 

Attorney Williams here in this room ja few 


weeks ago when he was presenting numbers and 
he said, Well, here are some people who have 
different risk differentials and absolute 
risk. He didn’t quite put it the way. But 
who all have the relatives risk. Ma^be these 


number t, 
analys: 
rates. 


^ake it different as well, iThese 

I 
! 

licate that they do not in quit 


So the result of your analysis is 


that absfTqte risk and perceived risk 


:er« 


— strike that. 1 

[ 

^ The result of your analysis is 
that piihsq.ived absolute risk is 
nonsigJfxT^ant, correct? 

r~\ j 

Yes. ; 

i 

And perceived risk differential is 
nonsigitrrrbant, correct? 

A. Correct. 

I 

Q. But perceived relative risk is 

significant? 

A. Correct. 



Q- 


And from that fact, those three 


facts, you conclude that relative risk is a 
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more important predictor of quitting behavior 
than either those other two risk measurements? 
A. Correct. 

Q. And if, in fact, it turhed out 

i 

that risk differential was significant and the 
other l^wo measures were not signifijcant, what 
would t^ffr^ conclusion be? 

I 

>:T 1 That the risk differential was the 



more e] 

says, 

MTlhei 

only d 1 



:ive predictor of quitting. 

I 

The last sentence of Paragraph 12 
e^e analyses reinforce my Opinion 
eived relative risk is a determinant 
or not people smoke." 

You're not opining that 
.inant of that question, jcorrect? 
Correct. 


it is the 


Do you have any opinionj as to 
whethe^^^rceived absolute risk is,| in fact, 
also a determinant of whether or nolt people 
smoke? 

i 

A. Let me be clear in answering 
this. Perceived absolute risk is an 

ingredient of relative risk. So itj does have 

I 

an impact in the sense that it is combined 
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with other perceptions to yield relative risk. 

It does not on its own appear from 
these data to have any independent impact on 

j 

. ♦ . i 

quitting likelihood while controlling for the 

other variables. j 

Okay. And do you have any opinion 

Tether it has any independent impact on 

ihavior? ! 



does m 


referr 

opinio 

whethe 

behavi 



This data suggests to me that it 


And — 


Sorry. To be clear, I was 
o absolute risk in that Hast. 

t 

Correct. And do you hdve any 
ependent of these data as to 
is a determinant of quitting 


Let's be clear. You're asking 
again about a direct effect on quitting 
independent of -- ! 

i 

i 

Q. Relative risk. 

A. — its impact on relative risk? 

know of no other evidence to suggest that it 
is. ! 
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Krosnick ! 

! 

I 

Q. So do you have an affirmative 

i 

opinion that it is not an independent 
determinant of quitting behavior? j 

i 

A. I can tell you that from all the 
evidence I know of on this point, there is no 
evidence that it is a determinant and, 
therefUilt^ I would conclude, at lea'st on that 


basis,| 


opinion 




risk d 
to whet 



ap it xs not. 

* And you're expressing a!n expert 

:e in this case that it is not? 

[ 

I 

Based upon this evidence, yes. 

And the same thing for jperceived 
efrential? Do you have an iopinion as 
it is a determinant of Whether or 


not peppTer smoke? 

* j 

Yes, I do. 

And what's that opinion? 

Based on this evidence, my opinion 
is that it is not a determinant. 

Q. Do you have an opinion:as to — 

i 

strike that. 

In the regressions that are 
discussed in Paragraph 12, you have assigned 

I 

each smoker a number from one to six; is that 


I 
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Krosnick | 

t 

correct? i 

i 

A. That's correct. i 

Q. That's each — each smoker or 

I 

former smoker — j 

A. Thank you. 

— gets a number from one to six? . 

I 

Yes. 

! 

IQ1T J Did you consider instead of 
assian&sngf them a number from one to six, using 
the aWSlft risk number that they expressed in 
the slirfl^-? 

Yes. 

I take it, did you, in| fact, do 



that? 



Do what? 

In fact run an analysis in which 

j 

■'he actual risk number rather than a 
m one to six for each smoker or 


you ui 

j 

numbe] 
former smoker. 

A. No. ! 

Q. So why did you not do that? You 
considered it, but you rejected it', it sounds 

j 

like? | 

A. That's right. 
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Q. Why did you reject it? ; 

A. I rejected it based on the nature 





23 

24 

25 


of the distribution of the variables 
involved. That when you v/ant to compare three 
variables like this, their distributions are 
very —Excuse me. Let me start carefully 


here. 



jin the case of relative! risk, the 


is what we call highly 


skewed. 


iap most people high up at|the 

relative risk and there is what's 
c^H^d #^.ong tail whereby some people have 
values, fve^ extremely high values on 
perceivecypelative risk. 

P* ‘ i 

, Now, some of those very! high 
values iifmgthe result of relatively 1 arbitrary 
decisiollppiht I made about four percent of the 
respondiFnlrP who had a value of zero on the 
denominator of relative risk. 

That is, the people who are asked 
out of a thousand nonsmokers, how many would 

i 

get lung cancer. The answer for a jsmall 
fraction of people was zero. Those people 
have an undefined relative risk. And so in my 
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1 Krosnick j 

2 calculations, I recomputed their vaCLue after 

I 

3 recoding the denominator to be one.j 
Q. Let me stop you there, j 

So the arbitrary decision you 
referred to was assigning people whjo had said 
zero a ^number one for purposes of ybur 

i; is that the decision ybu are 

!o? 

Yes . 

Okay. Go ahead. j 

So that decision placing people at 

I 

les to some extent how high, just 
iir relative risk values^ would go. 

lat number around "somewhat”, that 

! 

i 

iraction of the respondents would 

\ 

And they, some of them tend to be 

i 

of this distribution. 

j 

Now, a highly skewed distribution 
with a long tail has a very large variance. 

And that large variance is well-known to 

undermine statistical tests using conventional 

i 

23 statistics that presume normal distributions 

24 and multivariate normality. 

25 So to conduct a conventional 
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Krosnick j 

statistical analysis with distribution is not 

typically a sensible thing to do. 

Now, it turns out that the risk 

1 

differential is more symmetric. It!is not 
quite so skewed but it has very long tails, 
small hails. ! 

So again, there is a large 
ere that handicaps that measure. 

The risk — excuse me. i The 
sk variable is not quitej so 
fact, it has more of a normal 
ri bafc idn but it is a very spreajd 
riqP@llln with a variety of peaks in it. 

So in order to begin an analysis 
to a way that allows fcjr robust 


vananc 

absolu 

skewed 




like t 



estima 
have qi|i 
distri 



f the percentage of smoker whose 



various points along these 

i 

s with enough reliability at each 

of those points to generate plausible results, 

j 

I recoded those strange distributions into 

, i 

essentially a flat distribution with equal 

j 

proportions of people in each of these six 
groups. ! 

Therefore, to use the words that I 
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Krosnick 

used in the report, leveling the playing field 
so that we could look at groups of the sample 

i 

of equal size to then in a fair wayj compare 
the extent to which they could predict 
quitting smoking. 

Qhy 4 So you considered running the 
analysilosing the actual risk numbers that 

jg&ILJrespondents used, but you rejected 
>f the large variances in that 


No, it is not only the large 

i 

it is shape of the distributions, 
g tails, and the fact that the 

i 

i 

s are so different from; each other 
that th^LJ^ould, I believe, yield unreliable 


results ^l^bne were to analyze them; as they 
appear . 

: I believe if one could get a 

gigantic sample, hundreds of thousands of 
people that would then provide reliability at 
various points in the region, one could have 
more confidence in doing a fuller analysis. 

Q. Let me ask you about th!e 
chronology of that. I 
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Krosnick ; 

You considered it running it, 
running the statistical regression jusing the 
actual numbers that people used but then you 
looked at the data and saw the variances and 


other distribution problems that you 

identified.and instead decided to with the 

ordinai^one to six scheme; is that jcorrect? 
r* ^ | 

y Not really. I have been dealing 

data for months now and jl'm very 

of the distribution of these 

l And so, you know, it is — it 

that point that it seemed obvious 

In’t yield a fair comparison to use 

stributions. 


In fact, in my very first report 


m cas fessjgaa rtere I did correlation analyses 
involvillp^relative risk because of;the 
distrilfut^bn, I converted it to percent tile. 

Q. So is the use of the ordinal 

approach assigning each smoker andjnonsmoker a 
number between one and six, including one and 
six, the first option that you then 

i 

considered? ! 

i 

A. Yes. 
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l 


Q. And you settled upon that option 

and ultimately did use that option, correct? 

• I 

A. Yes. | 

Q. But somewhere along the way, you 
also considered using the actual risk numbers 
that thfeypepple had given in response to 
Test ions? 

I 

Yes. The chronology was such, as 
lat I sat down, it occurred to me I 
.s analysis in a way thajt would be 
this case. 

I said, hum, I can predict 
|Lng these three measures! of risk. 

>y are so differently distributed 
and the^aJt^wness and the long tails are going 
to prov|tefi&WEor not fair comparisons, so I got 
to find^!|^fe.y for normalizing these 
distributions more so than they are now. 

It seemed to me a simpie fair, 
nonpartisan way to do that is to do this 

i 

chunking into six groups. 



quitting 
Gee, but 



23 Q. What was the first wayjthat you 

24 considered doing? i 

25 A. That’s it. ’ 

i 

i 

i 
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Krosnick 

Q. The first way was to use the 

j 

actual risk number, but then you rejected that 

I 

because of the problems that you identified? 

A. I considered that not to be a fair 


But it was the first way that came 

I 

Yeah. I mean, sorry, let me be 



clear, 




me 



I'm guessing here about]the 

I 

which I had these ideasL I 


clfPikin|Pf^ know that the six grouping is an 
alternative! to using the raw distributions. 

0 .1^ And you never have run an analysis 
using t^^ajbtual risk numbers that survey 
respondlpi^ gave, correct? 

A^^^ That's correct. 

And you have no idea whht that 
analysis would show? ! 

A. I don’t know that I have no idea, 

I have some ideas. 


Q. 


Okay. Do you have some! suspicion 


as to what that analysis would show!? 


A. 


Yes. 
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Q. What's the suspicion? i 
A. Well, first of all, based, on the 
results that you see here, there really is no 
relationship at all between absolute risk and 

i 

quitting when absolute risk is considered by 


itself 

if 1 tha 
multiv, 
distrl 



! 

And so I would be very surprised 
iable had an effect in aj 
e analysis using the raw 
ns of those variables, j 
I could imagine that the other two 


would have either no effects because 
less of their distributions, or 
them would have a significant 
the other one would not j 
In fact, the analysis reported 
^does use the full distribution of 

i I 

ve — excuse me, of risk^ 
differential variable. And that revealed a 
significant relationship with quitting. 

j 

So clearly using that ifull 
distribution doesn’t completely eliminate the 
relationship in that case. 

I don't know whether the full 
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j 

distribution for relative; risk may or may not 
eliminate it. Then the question would be, if 
it were weakened, which I certainlyj expect it 
would be, is it weak evened slightly more or 
slightly less than the relationship!for the 

I 

risk deferential. i 

So I guess what I’m saying is I 


can ima 


certain 
that ~J 



one of three outcomes. I 
ould expect --- no, I can’t even say 
t either one of those two 


pred ic pops! would be significant, the other 
tf^iLd gttt, both of them could be significant, 

£ Ww . ' 

or neither:of them could be significant. 

1 h ave confidence that the 
absolufe''risk is unlikely to have ajpredictive 


effect ^y^^hat relationship. 

MR. BSCHORR: John, are!you ready 
on a new area? Do you ^ant to 

i 

take a break? J 

MR. MASSARO: Want to take a 

i 

break? There might even be lunch around 


here. 


MR. BSCHORR: We have been going 


an hour 45 minutes already. 
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Krosnick 
THE VIDEOGRAPHER: The :time is 
1:49 p.m. and we're going off the 
record. 

I 

(Krosnick Exhibit 2, 4/;4/01 
Supplemental Reliance List, marked for 
identification, as of this dajte.) 

(Whereupon, a short recdss was 


t-) 

THE VIDEOGRAPHER: 


The time is 


read t 



I don't recognize this. 


what it says. It says Professor 


I could 


Jon A.’Krosnick, Supplemental Reliance List, 

April 4, 2001. j 

| 

Q. But you have not seen this list 
before? 

A. No, I haven't. j 

Q. Did you provide counsel;with a 
list of additional materials that you were 
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3AR0: 

Welcome back, Dr. Krosnick. 

Thank you. 

We've shown you Exhibit'2. Can 
you pl@a^e, identify that for the record? 
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Krosnick ! 

relying upon since your last deposition? 

I 

A. I've been providing counsel with 

relevant references all along throughout my 

preparation for testimony. ; 

Q. Do the materials identified in 

Exhibit,,,2.appear to correspond to additional 

materials that you've identified to counsel as 

r~ i 

u were relying upon since your last 


(Witness reviewing document.) 

I don’t have any particular 

i 

ion of when some of these|references 
over. I mentioned them to 

I 

ome I know are things cbunsel has 

I 

I have not necessarily red. 

Do you have a particular example 




xn mini 


A. Of what? ! 

Q. Of ones counsel has given you but 
you haven't read. ( 

A. At the end here I see a long list 
of Viscusi documents. Some of which I have 
read, some of which I haven’t. 

Q. Which ones have you not read? 
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23 

24 

25 


Krosnick ! 

A. I don’t think I can tell you with 
confidence. 

Q. Can you tell me with confidence 
which ones you have read? 

I don't think I can tell you with 

i 

that I read any of this.j I may 

at them briefly, but I'm not. 

j 

Let me ask you about onje item on 
ast item on page 5. The; Oskamp 


Yes. 

J 

Are you familiar with that text? 
Yes. ; 

And are you relying on jit for your 

this case in any way? j 

The reason it is on here is that 

i 
i 


deposition here I was asked, I 
believe^^ let me say it clearly, t’m not sure 

when. j 

[ 

But I was asked at a deposition 
about the numeric scaling of the response 
choices for the ingredient for the- motivation 
to quit index and the combining of: them. 

And I was asked about what 
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Krosnick 

I 

precedent, if any, is there for doing that 
sort of thing in my field. And I sjaid it is 

i 

very standard practice. And so in jcase there 
are any questions about the extent ; to which it 
is standard practice, I grabbed a ^ew handbook 
chapte#&vand textbooks to include here that 
mention_th^t sort of procedure as standard. 

So are you relying on tjhe Oskamp 
f as support for the proposition 


text, 
that i 
iuc 




are re 


is i standard in the profession to 

analysis in the way that you did? 

i 

One piece of, yes. 

It is one of the sources that you 
on for that proposition? 

That's right. And it is only for 



one pi^PP^bf the analysis that I did. 

Are there any other items on this 
list tlfet support that particular proposition? 

A. There is a chapter herp, Dawes and 

\ 

Smith, D-A-W-E-S and Smith, that is included 
for that reason as well. I 

The Likert, L-I-K-E-R-T, reference 
is another one. 

(Witness reviewing document.) 
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1 Krosnick i 

2 A. And that is all. 

t 

3 Q. Let me ask you for eachj of them, 

starting with Oskamp at the back. j 

Did you consider it an j 
authoritative text, at least on the; point for 
which ^mj djr e relying on it on? j 

I don't know what you mean by 

ve. ! 

I 

Do you agree with the opinions 

i 

|n Oskamp? 

Yes. On this point. 

Is the same true for Likert? 

Yes. i 

And for Dawes? ' 

i 

Yes. 

I 

Let's move on then. Back to 

Exhibi |hich is the supplemental report. 

We are up to the last section beginning on 

i 

page 5 and carrying over on page 6i 
A. Uh-huh. I 

I 

Q. There you describe some additional 

23 logistic regressions that you ran;j is that 

24 correct? 

25 A. Yes. 
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Krosnick 

Q. And what was the reason; that you 

i 

ran those regressions? 

A. In his most recent report, 

j 

Professor Viscusi raised a question! about the 
design of the measures included in ithe SRBI 
assessing people's perceptions of 

i 

smoking. And in particular he 
ings. One is that he bejlieved it 
o ask people for a percentage out 
d, rather than a number ;out of 



And in addition, he belpeved that 
questions to measure perceptions 
to smoker and not smoke;r 
specifis more difficult and [error prone 
than sJSj^ asking one question alcjng the 
lines cfPpSje Audits & Surveys survey questions 
that he analyzed, that sort of got at the 
perception of the risk differential in his 
opinion reasonably accurately in a single step 
rather than in two steps. 

So in order to address|those 
concerns, it occurred to me that because I had 
access to the data from the Audits!& Surveys 
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Krosnick 

surveys that had implemented this slingle-step 
approach asking about a hundred smokers, that 

there was an analysis that I could ido to 

i 

compare the quality of those data to the 

| 

quality of the data yielded by the jSRBI 
measui So that's what I did. 

i 
I 

So one of the propositions you 

! 

|ng was whether the quality of the 

I I 

itter when you ask out of I a hundred 

| ■ ; 

ign you ask out of a thousand. 



Well, to be clear, the!design of 
eys is such that I cannot separately 

i 

assertion from also testing the 

a one-step process is better 

! 

-step process. So all i; can do is 
pare the package of lOoj smokers in 
a one-step' process to 100 smokers in a 
two-step process. 

Q. So you were testing both of those 
propositions, correct? 

A. Really what I was doing was 

i 

testing a more general proposition that my 
measures in the SRBI survey yielded less 
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23 

24 

25 


Krosnick j 

j 

accurate assessments of the risk differential 

! 

than did measures included in the Audits & 

i 

Surveys survey. So it is not even a test of 
those particular propositions, everything 
about the measure. I 

I 

O-. s So the available data did not 
permit pu to test just on its own Whether 

? ««»•>*' s 

f a hundred was better than asking 


asking 
out of 




usand? 

That's correct. 

But I take it, by that ifray, you 

j 

-— you do have the opinion that 
f a thousand is better than asking 
dred, at least in this context? 

awwwww S 

AYes. 

I 

Okay. So that was yourjmotivation 
in apprc ^ag^ ng these tests. Can you briefly 
describe what the tests were? 

A. Briefly what I did was to compute 
an association between the risk differential 
measured in each of the three surveys with 
status as either a current or former smoker. 

Q. And the outcome of that|test was 

i 

what? 
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Krosnick 

i 

A. That the relationship v^as stronger 

i 

in the SRBI survey data set than eijther of the 
Audits & Surveys survey data set. 'And that 
led me to conclude that the measure^ and 
approach used in the SRBI survey was no worse 
than ti ised in the other surveys!. 

Okay. Does it lead you 1 to 

I 

:firmatively that the measure used 
survey was better than the 
Jed in the other surveys? 

To do that, I would neejd to do a 
Statistical significance comparing 

two surveys to assess the 

! 

there was superiority tjhere. I 
|e that test, so I don’t j — I didn't 
;ed to make a statement about which 

! 

I was simply responding to the 

| 

question of whether there was significant 

J 

enough additional error to obviously 
compromise predictability. 

Q. The last sentence of your report 

| 

says, "This comparison suggests thait the SRBI 
measure of risk differential contains less 
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I 


my saying 


Krosnick | 

error which indicates that using the base of a 
thousand people did not compromise measurement 
quality.” ; 

First then, do you have;the 

i 

opinion that the SRBI measure of risk 
differen tial . has less error than the measure 
of ris#differential used in the two surveys 
relied by Professor Viscusi? i 

r Well, if you don't mind 

jtwo surveys are these Audits & 

! 

gyeys discussed here. Only because 
low what he is relying on or is not, 
with that. 

I 

So is it fair to say then that the 

I 

'■our test are that you have two 
Union, one that the SRBI[measure of 
inis less error than thosejtwo Audits 

Ml j 

& Surveys measure? I 

I 

A. No. It contains no les^ error. 

Excuse me, my mistake. Yes, you'rejcorrect. 

My miss tame. 

Q. Contains less error? 

i 

A. Yes. | 

Q. And then the second opinion is 
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Krosnick j 

that the use of a thousand versus a : hundred 

did not compromise measurement quality in the 

> 

SRBI survey? I 

A. Right. 

Q. And that's based on the! fact that 

the re^espion coefficients were j 
nonsignificant in the case of the 1'997 Audits 
& Surv fe^iJ but were significant in !the case of 
the SR^^^irvey? ! 

i 

No. | 

You did find in fact that the 
n 4 coefficient was — did you find 
gression coefficient wa^ 

I 

in the case of the SRBI survey? 



res 
that t 
signifi 



Yes, I did. 


signif fee 
Surveys? 
A. 

Q. 


And you found that it is not 

I 

in the case of the 1997 Audits & 


Yes. | 

j 

And you found that it was 
significant in the case of the * 85; survey? 

A. Yes. 

Q. And the fact that the coefficient 

was larger in the SRBI survey data than for 
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i 

the other two Audits & Surveys surveys is what 
forms the basis for your conclusion^ as stated 
in Paragraph 14? 

A. Correct. 

Q. And by "larger" you mean more 

negati#^ 

Yes. Thank you. 

I 

Which means that there was a 
ivation to quit; is thatj correct? 

I don't know what you're asking. 

I 

If the coefficient was more 

I 

that meant that it increased the 
^someone’s likelihood of quitting? 
Okay. Let me see if I pan explain 

I 

this. 


These associations here! are 

i 

exceptions of risk on the pne hand 
and having quit among current and fprmer 
smokers. So what this says is the highest a 
person's perceived risk differential, the more 
likely they are to have quit. Thatj's what 
that negative sign means. ; 



Q. 


So the negative sign indicates 



that if someone has a higher perceived risk 
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reverse 


all thef 
would tl 


about tl 



Krosnick j 

differential, they are more likely to be a 
quitter — j 

A- To have quit. ] 

Q. — at the time of this survey? 


Yes. Thank you. 

I So that if the signs were 
£ it were all the same numbers but 
fis were reversed, that would — 

J . ! , . 

lead you to the opposite!conclusion 
pliability of the various measures? 

| MR. BSCHORR: I'll object. 

j 

| Well, the sign can be reversed. 

4 an arbitrary result of iiow the 
|-e coded. And so you can only 
|Le sign in light of how the 
re coded. 

jSo in other words, if we flip the 



The sigi 
variably 
interpr^ 
variable 







coding of the variable, then you can get the 
reverse sign. But it wouldn't mean I that. 

Q. Sure. Let's assume thejcoding of 

j 

the variables is exactly the same, but the 

i 

outcome is that the SRBI coefficient were 
positive .062, the 1997 Audits & Surveys 
surveys were positive .047 and the *85 Audits 
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i 

1 

& Surveys surveys were positive . 03j5. Are you 

with me with that hypothetical? j 

i 

A. Yeah, okay. 

{ 

Q. In that worich that would mean 

! 

that the SRBI survey would — the SRBI risk 
measurehwould be inversely correlated with 
quittinlrbehavior, correct? j 

aLx3 Yes. Well — j 

The people would be lesjs likely to 
quit, t ^^^ reater their risk perception is? 

Only if the relation we|re 
strife stj^lly significant. j 


Correct. Let's assume jthe same 
3 as well. 


signifies 


Okay. I 

! j 1 

In that scenario, the only 

differefep^etween that world and tjhis world 
is that^tfiiP sign has changed from negative to 
positive. 

A. Okay. j 

Q. So that in that case, tihe SRBI 

survey risk measurement would be inversely 

i 

correlated with quitting behavior? j 
A. Yes. I 
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Krosnick I 

| 

Q. People would be less likely to 

i 

quit, the greater the risk they saw!? 

A. Yes. I 

Q. Would that lead you to ^conclude, 

then, that the SRBI survey's measure contained 
more e^or than the '85 Audits & Surveys' 


MR. BSCHORR: ObjectionL 
I would be reluctant to'.draw a 


lalong these lines from siich 


MR. MASSARO: We need to take a 

i 

reaR; for the tape change. j 

i 

THE VIDEOGRAPHER: The time is 
p.m., April 20, 2001. This is the 

f tape number one of the.videotaped 

j 

ition of Jon A. KrosnickJ We're 
oirig off the record. ! 

(Discussion off the record.) 

THE VIDEOGRAPHER: The time is 
2:36 p.m., April 20, 2001. This is tape 

i 

number two of the videotaped deposition 
of Jon A. Krosnick. We’re back on the 
record. 
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Krosnick 

BY MR. MASSARO: 

Q. So in the analysis that; you did 

I 

run, the fact that the coefficient was larger 

! 

and more negative, is what supportsj your 
conclusion that the SRBI measure of;risk 
contain^vless error? i 

That’s correct. 

But if the results were 
■ficient were larger and 



reversed 

therefore 


e, you would not reach fhe reverse 

i 

MR. BSCHORR; Objection;. 

I would be hesitant to reach a 

i 

yes. 

j 

Would you say, nonetheless, that 
the tesfelS^ported the conclusion that the 
SRBI suhPjjffl had more error than the! 1985 
Audits l' i ^^S:veys measure in that scenario? 

MR. BSCHORR: Objectionj. 

No. 

Would it have any evidentiary 



A. 

w* 

Q. 

23 

value at 

24 

whether 

25 

or more 
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Krosnick 

measure? j 

MR. BSCHORR: Objection;. 

A. See, you have to view any 
statistical test like this in the context of 
theory. That theory guides your 
interpretation of numbers in this kjind of a 
situatSLon. 

, 1 

And so what I'm doing here is 

i 

something that's called 1 

i 

lal validity, when you have two 
leasures of the same construct and 
:late it with some third variable; in 
status as of current and former 
smoker ^^ ien you can use the size ;of those 
coeffipie^is to infer the relative validity of 
peting measures, as long as the 
observed makes theoretical sense. 
And in this case, the premise of 
this analysis is that people who quit smoking, 

I 

according to very large literature] do so 
primarily because of concerns about health 
effects. 

| 

So on those grounds, it seemed to 
me reasonable in this analysis to explore the 
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relationship between perceived riskjand status 

of a person as a current or former smoker. 

i 

Now, that theory anticipates a negative 

I 

relationship given the coding of the variables 


here, 


;; Now, if I were to see a 


positive 




relatioilship between these variables, as 

1 j . 

|ng about — and you’re saying it 
^ly be a positive relationship but 
a statistically significant 
as well — I would find that 
apd puzzling based upon the 

premise that brought me!to this 


Then, in other words, looking at 


this relHIBlfby saying, I see the relationship 
that I jp|)e|t and if anything, it' s! stronger 
with this measure than that measure, 
therefore, this measure appears to be no worse 
and, in fact, contains less error than that 
measure. ! 

i 

But if the relationship!were 
reversed, I would say the basic foundation of 
this analysis is called into question. 


i 
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Krosnick 

Because in fact, former smokers do 'not 
perceive a greater risk, in which case, it is 
not clear what may be confounding the 
relationship, and so on, and we should draw no 
conclusion. That's why I would not draw a 

i 

conclusion. 

($r 'So if the coefficients were 
reverss ^d the sign in the manner we have 
been di ? ^|^Psing, you would not want , to draw 
any con|f?us|-ons at all from the test; is that 


I could say, Gee, the relationship 

i 

here. But I would havejmore 

rawing any conclusion about the 

^ ! 

iequacy of the measures that we’re 


And the reason for that would be 

( 

because Hthe^result of the test would be 
inconsistent with one of the assumptions that 
you entered the test with? ! 

A. Precisely. 

Q. And the assumption that iyou test 

with is that increased perception of risk 

j 

leads to increased quitting behavior? 
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2 
3 

r h 




1 16 




| 

i 

A. Yes. 

Q. Is that — do you have an opinion 

i 

as to whether that assumption is accurate? 

Yes . 

| 

You believe that that ijs accurate? 
Yes, I do. I 

You believe that increased 
f risk leads to increased quitting 



^Yes, I do. j 

And in particular, you believe 

leased perception of risk differential 

—» I 

:reased quitting behavior? 

No. 

Q^^That is the assumption that 
underli^l^^.s is particular test, i's it not? 

A^^^No, it isn't. As we talked about 
earlier, risk differential and relative risk 
are both, when examined independentily, 
correlated with quitting behavior; relative 
risk more powerful than the risk | 

differential. And when both are considered in 
the same simultaneous analysis, relative risk 
maintains a significant effect while the risk 
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1 Krosnick 

2 differential does not when the — in the 

3 analysis that I described earlier. [ 

i 

The results here are predicated on 

f 

I 

that logic that when considered individually, 

this measure of risk — not the optimal 

measure^pf risk — a less than optiitial measure 

of riskPffuat is correlated with what appears 

optimal measure of perceived risk 

. i 

id with quitting behavior. So I 

relationship as a gauge of 

j 

of quality. i 

Let’s set aside whether jit is the 

>ure of risk or not. I 

1 

Okay. 

Q 11 is an assumption that] in the 

tests tl^OT^rou’re running in Paragraphs 13 
and 14, perception of risk differential, 

increased perception of risk differential 

S leads to increased quitting behavior? 

A. No. j 

Q. And do you believe that ^increased 

23 perception of risk differential correlates 
24 with quitting behavior? , 

25 A. Yes, I do. 
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Krosnick | 

] 

Q. is that an assumption of the tests 

that you’re running in Paragraphs 13 and 14? 

A. Yes, it is. 

MR. MASSARO: Let's have this 
marked as the next numbered exhibit. 

(Krosnick Exhibit 3, Printout of 

i 

feriick's file "Output", marked for 

jj ! 

ification, as of this date.) 

I 
l 

Dr. Krosnick, can you identify 

i 

I I see this is labeled "Printout of 

1 i 

file named 'Output - Audits & 

- Risk Diff Cause Quitting." 
Looking at the second page of the 
exhibit judges the exhibit, in fact, i appear to 
be whatbfefae# first page indicates itj is? 

(Witness reviewing document.) 

Af" ? It seems reasonable, yes. I don't 

| 

have a specific detailed memory of what these 

I 

output files look like. j 




Q- 


There is an indication that the 


file was — the output was created bn 

March 28, 2001, does that seem about right for 

when you ran the logistic regression that's 
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Krosnick ; 

referred to in Paragraph 14 of the report? 

(Witness reviewing document.) 

A. Yes. It says output created 
March 28, yes, I see that. 

Q. Does that seem about right for the 
time period, which you ran the logistic 
regression which you refer to in Paragraph 14 
of you 


rt? 

i 

1 

It sounds possible, yesJ 

I 

And it has an input line, input 
u see the description there, "2000 
udyWiscusi 1985\Viscusi 1985 survey 

I 

Yes. I 

I 
I 

, 4 . I 

What does that indicate? 

i 

That indicates a file oh my hard 

! 

data for the 1985 Audits & 
rey. 

And the number of rows in working 

data file is 3500; is that right? j 

(Witness reviewing document.) 

A. It says that. I'm not familiar 
with this particular piece of printout, the 
notes. But that seems to say that, yes. 
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Krosnick j 

Q. Then in the syntax, there is a 
description, "logistic regression Var equals 
q4," what does that mean? ( 

A. Of dependent variable is q4. 

Q. Is "q4" is question four from the 

Viscusibvfrpm the 1985 Audits & Surveys 
survey?! 

I'd have to look at my dotes to be 
it that seems like a plausible 
.on. 

i 

Under the dependent variable end 

i 

>wards the bottom there, do you see 


Yes. 


what does "internal value" mean? 


(Witness reviewing document.) 

A^P^ I assume that SPSS is recoding 
this variable to be a 0,1 value pair as 
opposed to a 1,2 value pair which is what was 
provided in the data. 

SPSS is the software? j 
Yes. 

When you say the software is 



"sf* 

Q. 

23 

A. 

24 

Q. 

25 

recoding 
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Krosnick 

that it should be recoded in that nianner; is 

I 

I 

that correct? j 

A. No, I did not determine' that. 

i 

SPSS may recode dichotomous dependent 
variables for logistic regressions jfor 0,1 

i 

regardless of how they are coded. iPerhaps 
that be what this is about. i 

1 So you're not sure whether you're 

j 

decided it should be 0;, 1 or if 

that's a function of the softwjare? 

I 

I’m certain that there jis no 
>r£ whereby I instructed ijt to do any 
ig. 

And what this means is that the 
.ue is the value in the 1985 Audits 
ita? | 

^I would have to go backj to my data 
set to Confirm this for you. 

Q. Well, the internal value, do you 

| 

know what the internal value is? What does 
that mean "internal value"? 

f 

A. Again, I'm not completely sure. 

1 

But I presume this is indicating that the 
package has recoded the variable which was 
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I 


Krosnick 

coded originally 1,2 in the data set provided 
to SPSS as 0,1 for this analysis in!the form 

i 

shown on this table. j 

Q. Got you. So you're presuming that 
it means that in the original data,|if the 
variablewas a one, it is being recoded to be 
a "0" fill' purposes of your analysis? 

A jttlhhii It may do that. I woulii be 
relucta^iMSb offering an opinion onjthis 
without -consulting the manual. 

You can't tell from looking at 
tSf^i Ex >it 3 on its own? 



Q. 

possibi 
you 1 re 



That’s correct. 

What other, is there some other 
that — specific possibility that 
dering? 

MR. BSCHORR: Object ion j. 


A: I’m not considering anyj 

possibilities. ; 

Q. You can't, again, make jieads of 

tails of this is what you're saying!? 

! 

MR. BSCHORR: Objection^ 

A. No. If you would like me to 

i 

provide a detailed explanation of what this 
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Krosnick j 

particular piece of the output would mean, I 
would need to consult the manual. But without 
doing so, I can’t tell you for sure;at the 
level of confidence that I would like to have 

l 

in this deposition how to interpretjthis. 

i So you don't have — you don’t 

feel colntortable answering the question of 

sr 1 

5 i ! 

iernal value means? i 


what tl y _^ 

That' s correct. j 

; But you are certain that you 

er made a decision that| original 

! 

the 1985 survey data should be 
1,2 values into 0,1 values? 

All I can do is look atj this 
printou^anpl tell you what I see onj this 



printout 

tit 


I’m just asking you really for 


your mebory of what you did in running this 
reanalysis. 


A. Yeah, and I can't tell 'you the 
specific procedure. i 

i 

Q. So — 

I 

A. By looking at my report here in 

i 

which I describe this analysis, I describe how 

i 

SPHERION DEPOSITION SERVICES 
(212) 490-3430 



http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offll<v.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5882 




12 4 


1 

2 

3 


Krosnick 

this variable is coded in Paragraph 
for former smokers, "1" for current 


13: "0" 
smokers. 


And then in Paragraph 14, I talk about how I 

i 

coded the perceived risk differential. 

And that would be the account of 



at I would stand behind in 


describing 


he result produced in Paragraph 14 

Okay. So Exhibit 3 reflects a 

i 

n 1413; is that correct? 
jjMR. BSCHORR: Do you warit to look 
?ugh the entire length? j 

1 £ i 

<(Witness reviewing document.) 

* | 

■The numbers that I see ip this 

^rrespond to some of the numbers 
^Paragraph 14, yes. 

)kay. Paragraph 13, no?j 
^Witness reviewing document.) 

I was looking at -- | 

My question was about \ 

Paragraph 13, actually. 

A. Okay. What I’m describing to you 

is what'5 in Paragraph 14 in terms of the 

| 

significance test in the coefficients. 



SPHERION DEPOSITION SERVICES 
( 212 ) 490-3430 


http://legacyJibrary.ucsf.edBbtii(il^ql9ff|a^/pnillw.industrydocuments. ucsf.edu/docs/qyhl0001 


52434 5883 




1 

2 

3 



K-v 


11 





23 

24 

25 


and a 



i 125 

Krosnick 

Q. Is Exhibit 3, the logistic 

regression on the perceived, the effect of the 

! 

perceived risk differential on smoking status 
in the 1985 Audits & Surveys data? 

A. Partly. Part of it is. 

What part? 

* 

The first part. Page lj, page 2 
|e tiny bit on the top of page 3. 

* And on page 1, then, the 
.on ,; of the dependent variable in 

|re's a discussion of the variable, 

leone is — the variable jthat 

i 

lether someone is a current smoker 
loker, correct? 


I’m sorry. One more time. On 


page; 


I 


Looking at page 2 of the exhibit? 


A. 

Page 2 of 

the 

exhibit. 

Q. 

Which is ■ 

— 


A. 

Page 1 of 

the 

printout; 

i 

Q. 

-- page 1 

of 

the printout 


is a description at the bottom of dependent 
variable end coding; do you see that? 
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Yes, I do. 
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I 

Krosnick I 

Q. And the dependent variable is the 

variable that describes whether soitileone is a 

i 

current smoker or a former smoker? 

i 

A. Yes. 1 

i 

Q. And in your logistic regression, 

1 

the fdrmer smoker is coded as a "0" and a 

currerlr smoker is coded as a "1"? i 

r i i 


That’s correct. 

And that is — where d|d you, from 
where [did j vou determine whether the person who 

i 

he 1985 survey was a former or 
smoker? j 

From the original data set. 

And what part of the original data 

i 

I 

There is a variable in there which 
he original data set called q4 

i 

oker status. 

Q. And from looking at Exhibit 3, the 




set? 

may beF 
which 


second page which is the page we T ye been 
looking at, if the value of q4 was one in the 

1985 Audits & Surveys data, then that person 

I 

was a former smoker and they were: coded as a 
"0” in your logistic regression? , 
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A. 


Krosnick I 

I can’t say that. You can say 



that if you want to, I can't. I know when I 

i 

did the analysis that’s what I did. J I don't 
know that what appears on this page|shows 

I 

that. ! 

I 

^When you did the analysis, if the 
is jcoded as "1" for question four in 

Surveys data, you coded them as a 
^— a former smoker in your 




|I can't recall how the original 
led sitting here today without 
original notes. j 

/hat I can tell you witii 

i 

confideriee"-4^s that however that measure of 
smoking PWlfus was coded, I transformed it so 
that smokers" were coded "oj " "current 

smokers" 1 were coded "1," and "never j smokers" 
were treated as missing the values.] 

Q. Let me ask you, that is;slightly 
above the dependent variable discussion. 

There is a discussion of case processes 
summary; do you see that? 

A. Yes. I 
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Krosnick ! 

i 

Q. And there's a mention of missing 
cases, 1748. Do you see that? j 

A. Yes. j 

Q. How did. you determine what a 
missing case was? 

i 

fey, I didn't personally determine what 
a missing case was. The program dropped cases 

rvi ! 

that headBg&hv missing values on either of the 
variab|$§^g^nvolved, the independent^ or the 
dependehtyariable. 

[ 

That means that if somebody was a 

:r Sfffpker or failed to answer the smoker 

& teklf 

status [ques tion, they had a missingj value. 

And if person failed to answer thje risk 

differential question with a number between 

zero aite§^0, they were treated as jhaving a 

mi s s i nd^Pn. ue. 

qT ' So, what is the implication of 

being treated as a missing value? j 

j 

A. Those cases are not included in 

this analysis. ! 

< 

Q. So not included in this analysis 

is anyone who was a never smoker? ' 

• i 

A. Correct. i 
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answe 



Krosnick 

i 

Q. Anyone who failed to answer the 

j 

risk differential question? | 

A. Correct. | 

) 

Q. And anyone who provided an answer 
to the risk differential question that was not 

i 

betwe#?r,j^ro and a hundred? 

Well, what I said, does not 
valid answer. ! 

i 

Anyone — so what is a! valid 
what’s a not a valid answer? 

I’m a little foggy on this. 

i 

^believe in one of the surveys that 
i*y|ed, there were cases in (which people 
tswer the risk differential question 
initi^liy^with a single nuinber, but rather 
gave c^^rfge. | 

And those people in Professor's 
Viscusi's analysis were given a value in the 

j 

middle of the range. I believe something of 
that sort. So they ended up in his analysis 

I 

with what's considered a valid value. 

Q. In your analysis, they would not 
be considered a valid value? ; 

A. No. I replicated asjclosely as I 
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23 

24 

25 


Krosnick 

could whatever he did. 


Q. 


So then -- so tell me what an 


invalid answer to the question would be such 

i 

that it would be excluded from yourjanalysis. 

i 

A. I would have to reconsult the code 

e you all of the categories. But 

i 

assume it is either people who said 

I 

w what the risk differential is, or 

p answer the question about what the 

ential is, or the interviewer 

I 

y failed to ask that question or 

i 

et coded properly, or the 

I 

failed to answer the smcjking status 

; 

ither because they said they don't 

y refused or the intervilewer failed 

i 

r it failed to get recorded. 

! 

Okay. I get what you're getting 



at. 


A. 

Q. 


Okay. Great. 

So if someone refused to answer 
the smoking status question, they would be 
treated as not a valid answer and they would 
be a missing case? 

A. For this analysis, yesi. 


I BEST 
COPY 


SPKERION DEPOSITION SERVICES 
(212) 490-3430 


http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offll<v.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5889 





131 


1 

2 

3 






Krosnick 

Q. And if they didn’t answkr for one 

reason or another the risk, the perbeived risk 

I 

question, again, they would be treated as a 
missing value and excluded from your analysis? 
A. Yes. 



; Why did you want to exclude those? 

i 

Well, what I wanted to do in the 
ported in Paragraph 14 of my recent 

j 

o conduct an analysis thkt is 
what I could do with the SRBI 


Now, in the SRBI surveys only 


people [who I were current or former smoker were 
asked to., sport their perceptions of risk and, 

^ I 

^were in a position to provide data 
ie extent to which you can predict 
current and former smokier using 
perceptions 5 of risk. j 

Now, in the Audits & Surveys 

survey, not only were risk questions asked of 

i 

current and former smokers, but in Addition, 
never smokers were asked those questions as 



well. 


But because there were ino "never 
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1 Krosnick ! 

2 smokers" in the SRBI survey, I couldn't use 

3 them in any way in this analysis to] have a 

i 

4 parallel to the SRBI survey. In other words, 

i 

5 there were no non -- never smokers jto compare 

6 it to. ' 

I 

Therefore, to make this an apple- 


to-ap 

from 



omparison, I eliminated those people 



never 



^analysis. > 

And by "those people," ]you mean 
>rs? i 

i 

Right. J 

i 

And I imagine the same)is true for 
peop 1 failed to answer the risk 

percep tion., question; I assume there were some 
people^frriihe SRBI survey who failed to answer 

I 

risk perception questions; is that 


f 

Yes. 

I 

J 

And they were, excluded] from your 

Yes. I 

— in SRBI? ! 

Yes. 

So for the same reason, you wanted 
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Krosnick j 

to exclude them from your analysis of the 1985 
Audits & Surveys survey? 

A. Well, it is not — I didn’t have 

any choice. I had to exclude them because 

j 

they didn't have an answer that I could use. 

Sorry, let me just add one 

I ' 

just to be clear. J 

Sure. 

^ I may have misled you when I said 
ould be treated as having missing 
ey said don’t know. In!both 
epple who said don't know!were 

o offer an answer. And;so I took 

! 

e answers that they offered when 

. i 

* i i 

they weta^encouraged to do so in both surveys 

rTj i 

in a paps^iil way. 

S So I just want to be clear that 
ial don’t knows were treated as 
missing, only those that people insisted they 
could not provide an answer. ; 

Q. So if someone said don't know in 
response to the first time the question was 
asked but ultimately gave a number, those were 
not missing cases? 
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1 Krosnick 

2 A. Correct. 

3 Q. But if they persist as saying 

don't know, then you treated those as missing 

i 

cases? 1 

I 

Exactly. j 

And they are not included in the 
regression? 

Exactly. ! 

Let me ask you about ; 

|4. There is a parenthetjical there 
ndicate you "divided perjceived risk 
by a hundred to make the 

Regression coefficients l|arger and 

i 

compare." J 

i I 

■ Did you divide the SRBIJ perceived 

i ! 

?ential by a hundred? 

(Witness reviewing document.) 

What I did is to make alll of these 

i 

t 

comparable. So they began by placing — for 

example, you're using this risk differential 

| 

here. The risk differential ranges in its raw 
form between 100 and zero in the Audits & 
Surveys survey. ; 

And so I divided those |numbers by 
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Krosnick i 

a hundred so as to produce -- it turns out 
these relationships in that raw form are — 
yield very small coefficients with jlots of 
zeros in front. They are essentially the same 
numbers but they have more zeros in front of 


them. N§o si divided by 100 in that case 


Now, in the case of the SRBI 

1 

e range, the possible range there is 
It's from a thousand to minus 



And so therefore, in order to get 


he same scale, I had to divide it by 


|, not by a hundred. 

Okay. That was — youjjust 

i 

answerbd^precisely the question I was asking. 

Great. j 

i 

So you didn't divide all of the 
percei^^^risk differentials by a hundred, 
correct? I 


A. 


Well, I did it I believe in two 


steps. One is to make the SRBI number first 
comparable to the others, maximizing at a 
hundred, and then divided that nuiriber by a 
hundred. j 
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I see. So you did divide them all 

j 

Right. After a initial! recoding. 
You divide them all by a hundred, 

Yes. ! 

i 

But prior to dividing them all by 

ou first divided the SRBI 

i 

ten? 

i 

Yes. 

And you had to divide the SRBI 
by ten first in order to 'make them 
c onto a r a^le_jt o the Audits & Surveys jresponses? 
A.^^ Correct. 

^ Because the Audits & Surveys 
re out of a hundred, whereas the 
ses were out of a thousand? 

I i 

■ Exactly. : 

MR. MASSARO: Let's matk this as 





the next numbered. | 

(Krosnick Exhibit 4, "Variables in 
the Equation", marked for 

| 

identification, as of this date.) 

Q. We had marked at Exhibit 4, I 

1 
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24 

25 



a document. Can you identify that? 
You'd like me to identify this? 
Yes. If you can. 

(Witness reviewing document.) 

It looks like the second half of 
in Exhibit 3, which appear to be the 
of' the 1997 survey reported on 
of my report. j 

What is the dependent variable? 

$ • f. 

The dependent variable in what? 

i 

The logistic regression!of the 
s. & Surveys? I 

Okay. A variable called "smoker." 
And what’s the independent 


variable-?™,. 


'lung 


cest, 


It's a variable called 
I-G C-E-S-T. 

i 

Q. 5 And what's your understanding of 
what the meaning of a dependent variable is? 
What is that variable capturing? I 

A. It is capturing the same thing 
described in Paragraph 13 of my report when 
this analysis is conducted which is the 


difference between current smokers land current 
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Krosnick 

smokers. 

Q. It's meaning to captureiwhether 

someone is a former smoker or current smoker? 
A. Correct. 

And the independent variable lung 
j.s that capturing? 

That I believe is the respondents’ 

i 

s j 

i the probability that a smoker will 

l 

icer as a result of smoking, or 
directi 2 number out of a hundred smokers 

w /ou| it. 





And then the purpose of 


the 


QJ 

| 

logistij; 

the inde.P^dent variable has predicted a value 
with respect to the dependent variable? 


ression is to determine] whether 



Yes. ! 

T2 i’* learning. j 

And so the purpose of the 

I 

regression is to determine whether jthe 
respondents’ estimate of a probability that a 
smoker will get lung cancer are predictive of 
whether or not respondents are former smokers 
or current smokers? 

A. Yes. 1 
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Q. 


Krosnick j 

And the dependent variable, then. 



analy 


is going to be binary, the person ejither is a 
smoker or a former smoker, correct? 

A. Current or former smoker, yes. 

Q. There is a spot here. 'On the 

i 

That's reflected in treating 
or a "1," correct? 

That's what was done for this 
yes. 

And the independent variable 

j 

he n be a number between zero and a 

correct? I 

^ j 

Not after dividing by a hundred. 


.Q. * It starts out as a number between 

3 ; [ 

hundred, and then you divide that 
a hundred? j 

Right. j 

Q. So it's a number between zero and 




one? 


A. Right. j 

Q. And it should be a range of 

fractional numbers between zero ahd one, 
correct? i 
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Krosnick 

i 

A. Yes. | 

Q. It is not a binary thing where 

i 

someone should be either "0" or "l"j? 

i 

j 

A. Correct. ; 

i 

MR. MASSARO: Let's take a 
i-minute break, five-minute|break, 

:t of go through my checklist see 
I am. 

THE VIDEOGRAPHER: The time is 
i.m. We’re going off the record. 

i 

(Whereupon, a short recess was 


■ 1 i 

THE VIDEOGRAPHER: The -time, is 
D.m. and we’re back on tlpte record. 
MR. MASSARO: Thank youj 
rosnick. I don’t have any further 

.ons at this time. | 

! 

I understand that counsel for 
another Defendant will be resinning the 

deposition at about five o'clock. 

1 

THE WITNESS: Very good( 

MR. MASSARO: Thanks for coming up, 
THE VIDEOGRAPHER: The time is 
3:27 p.m., April 20, 2001. This is the 
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Krosnick 

end of tape number two of the videotaped 
deposition of Jon A. Krosnick;to 
continue at five o'clock. We're off the 
record. ! 

(Whereupon, a recess was taken.) 

Ks... , the VIDEOGRAPHER: The time is 


4 h 58 .jp.in.. We are back on the record. 

■ ~ 2 unsel please introduce themselves 


I 


MR. WILLIAMS: My name i's John 

i 

from the firm of Collier 

i 

lnpn Scott. ! 

Does everyone else needj to be 

luced? 

i 

EXAMINM^I©^ BY 

MR. WIllM^S: 1 

I guess I am introducing myself, 
Dr. Krosnick, because I was doing something 
else earlier today. Thank you for staying 
here so I can have the opportunity jto visit 

i 

again. j 

i 

A. Certainly. j 

Q. Let me start by saying jwhen I 

arrived, I was surprised to learn and 
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Krosnick 

obviously complemented to learn thajt you would 
refer to me as a peer reviewer on ypur third 
supplemental report. i 

I appreciate that. Sinjce I’m 

appearing here in the guise of a fatuity 

I 

member ^4 would like to ask you if [you did the 
homewolif Igave you from the last deposition. 
In fact, I did. j 

You did. j 

1 Let me refer to Krosnipk Exhibit 2 

,1 

eposition. This was a pjrintout 
|ac| done of the medians from your MTQ 
jhat right? And "MTQ" stood for 


1 
w 

index; 
what? 



You're naming it that way. It is 
up to }^^rfhat you want it to stand for. I 
assume ^Ij^mean motivation to quit?! 

0. ! Right. And did you ha'pe an 

opportunity to determine whether these were 

i 

properly calculated medians on the |MTQ or 

l 

motivation to quit index? ; 

A. As I recall my homework 
assignment, I was asked to compute I the median 
for the index which would be the second to 
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Krosnick 

j 

last column here on this table whicli I did do 
Q. How did we do? 

A. I saw numbers like these, yes. 

I 

Q. So if we were to present this 
on — are you testifying on Monday?| 
i I assume. i 

i 

If we were to- present this on 

i 

would be able to confirm that the 


here are correct, that the medians 



say, 1 : 


calculated of the MTQ are, in 
ate? j 

The second to last column-/ as I 

i 

do it the way you appeared to have 
e, I get this same result, yes. 


done it 

Now, I want to ask you just a few 
questi^M^^o make sure I understand! the 



erval concept. Let me akk this 


ordina: 
question, 

On your regret scale you used a 

i 

few answers with the respondents. The answer 
being, I believe, "a great deal," "a lot" — 
what were they? j 

A. "A great deal"; "quite ja bit”; 

j 

"somewhat." I 
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Q. 


Krosnick 

"Quite a bit." Right. 


144 


"Quite a 


bit"; "somewhat"; "a little"; and "jnot at all"? 
A. Yes. j 

I 

Q. And then what you did djs you gave 
a score of one, two, three, four and five to 
those responses, right? 

That's correct. 

i 

Now, you could have, if you had 
wanted asked the respondents on a scale of 

j 
! 

one to i, how much do you regret having 

smoke? You could have done that? 

i 
| 

Is that a question? Yes. 

Could you have done that? 

i 

i Yes, I could have. ! 






^And do social scientists sometimes 


on like that on a scale 


of one to 


cale of one to five, give me an 


I 


Yes, they do. 

And with respect to those answers 

i 
I 

and the textotomy we had called interval 
ordinal, what would you call that(type of 
response? ' 

A. The one to five. 
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Krosnick 

The one to five, right. | 
Well, it's — that's anj 


interesting question. 

Q. Thank you. 

A. It turns out that there’s a 

i 

sizeablb QLlit erature indicating that |when you 


offer atscale of that sort, a one to five 

rvi i 

numbere dAim 1 e to respondents -- and I assume, 

* \ i 

just to^^Fclear here, you are puttijng on some 



verbal 



s on the end to tell pecjple what 


mean. 


an intea 


questio 



^ We will get to that because that's 
dng answer to an interesting 


ut go ahead. 


AN—x Well, if you're not going to 
specifyNWRiher you got labels on it, I would 


say it 



rijo scale at all. 

Not a scale at all? 



Yeah. 


Now let's put labels on jit. What 


labels would you put on those? 

A. Well, I have never seen !a one to 
five scale offered to respondents in social 

I 

science without verbally labeling at least the 
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Krosnick ! 

I 

end points. So you know whether five means a 
lot of regret, no regret. j 

i 

Q. Understood. So what you would say 

, 1 

is on a scale of one to five, how much do you 

regret smoking, with one being the'lowest and 


five 


have 


that. 



the highest? 1 

Something of that sort. So you 

i 

that. j 

i 

Understood. Assuming you did 



Now, it turns out that what the 
e shows is that when you .(offer a 
that with numbers on them, 

?s need to try to decode jwhat do 

i 

those panmbers mean in between those end 
points|^^& s at 1 s the conceptual meaning of each 
of thc^^^oints. 

^ And so in order to use the 
numbered scale, they have to put some verbal 

meaning to each of them. And people do that 

! 

process in a relatively unreliable and 
inconsistent way across people. 

So putting verbal lab'els on all of 
the points establishes a more universally 
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one, t$rfO, 
on itsWll 


Krosnick f 

interpreted and reliable and accurate measure 
of whatever the construct is. 

The point being that you would 

l 

like to view the one, two, three, four, five 

i 

perhaps as a — let me rephrase thajt. 

I 

One might be increased to view the 
ithree, four, five scale ajs obviously 
an interval level scale'. Because 

I 

e options given to people are, in 
ly numerically spaced, j 
But from the point of view of the 
process, what you need!to 
is how do people interpret those 

l 

s, what meanings do they place on 

| 

points. j 

And despite the fact that you 
might wifeh; for them to treat them (as equally 

spaced', there is evidence that they don't do 

I 

that and that you can improve the juniversally 
of interpretation by putting words on each of 
those points. 

| 

So to answer your question, I 

guess I have to answer it in two ways. On the 

i 

one hand, on its surface would appear to be a 
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Krosnick 


set of response options with equal spacing. 

i 

But in the minds of respondents, it's not at 

i 

all clear that it will be interpreted that way 
with regard to the rating dimension 1 of 
interest. | 

Okay. Are you going tol answer the 



questrtn^ 

MR. BSCHORR: I think he just 

I 

i 

i 

No. The question is: Would you 
|an interval scale? ! 

Well, I thought I just answered 

} 

But the question is then, are 

I 

the —Hwhajt ate the meanings of thpse 



respo 

conce 


options, and can you talk 1 about the 


jar spacing between them? 

f 
i 

When we use a scale thpt has 
verbal labeling as I talk about, you can get 
some sense of what the interpretations are 
placed on them, so you are in a position to 
describe the intervals used. 

And when you are using the 

i 

numbers, it may well be the case that you can 
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Krosnick : 

I 

gauge what those intervals are as well, but 
not necessarily just simply from the fact that 
it is — j 

f 

Q. I'm not asking you, Doctpor, if you 
can gauge them. I’m asking you simply what 


you wo 



yes 



all that scale. 

You have written a textbook, have 
which you have discussed various 

j 

s one can make with a ordinal scale 

i 

rval scale and a ratio scale, 

i 

I 

r 

I’m a coauthor of a texjtbook — 

Yes. , 

— that talks about those issues, 

I 


Okay. And my question [then is: 
What wc^^T^you call the type of scale where 
you ask people to give a number on ja one to 
five or one to ten basis, ten being the 

I 

I 

lowest -- zero being the -- ten being the 



highest , 

zero being 

the lowest? ; 

23 

A. 

Yeah. 

1 

j 

24 

Q. 

Is that 

an interval or.ordinal 

25 

scale? 


1 
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Krosnick 

A. It is both ordinal and it has 
interval properties. 

Q. It is ordinal and internal? 

A. Yes. 

Q. It is an ordinal scale With 

intervalvprpperties; was that your 'ordinal 

scale with interval properties; was' that your 
r ! 

answer?^^d ! 

As That’s right 

^ What if you.gave them the 

hoices, how much do you [regret 

a one to five scale, one' being a 



two being quite a bit, jthree being 

ur being a little, five! being not 

I 

at all?h-.v“What would you call that type of 
respons your textotomy? 

Where you are giving the numbers 
he verbal? 

As well as the verbal labels. 

I would say the same. \ 


A 

as well 

Q. 



A. 

Q. So it would be an ordinal scale 

i 

with interval properties? 

A. Uh-huh. I 

Q. Okay. Now, what would you call 
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Krosnick 

the type of scale where you have no numbers, 

| 

the person is not given a choice of jnumbers, 

I 

only a set of verbal responses, "a great 
deal," "quite a bit," "somewhat," "a little" 
and "not at all"? 

A. sJThe same. ! 




The same, 
e? 


You would call it an 

i 


l 


What I said earlier it is both 
interval. j 

But you could call an ordinal 
Interval properties? j 

Yes. | 

So in all three cases, one through 

five, alhgreat deal through not at all and a 


great d^^through not at all with the one 
throughattached with it, you would call 
an ordinal scale with interval properties? 

A. Yes. j 

j 

Q. Just so I understand it|, it is 
therefore the interval properties that permit 
you to then go on and calculate an laverage, is 
that right, and to subject it to statistical 
significance testing? 
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Rrosnick • 

i 

I'm hesitating on the wjord 
I'm not sure what you mejan by 

| 

What don’t you understand about 

i 

, I’m not sure what you mean by 

I 

In other words, I can take any 
and conduct any analysis I would 

l 

I 

♦ f 

i 

| 

Within the bounds of scientific 
y, correct? j 

That’s a different matter. 

If you want to get a peer review 


by some 


such as myself? 

Which is yet another matter. 
Right. Okay. j 

It is the numerical features of 

your ordinal scale with interval properties 

I 

that permit you to do quantitative j 
calculations? 

A. I’m sorry, I would like to be 
helpful. I guess what I will say is I can 
agree with the assertion that eachjof those 
scales can be subjected to statistical 
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Krosnick 

j 

analysis using statistics based on interval 
properties. But it is the "permit" that I'm 
having trouble with. 


Q- 


Well, if you just had a Iset of 


responses of "a great deal," "quite a bit," 

"a little" and "not at all" — 

! 

Yes. j 

you could not do any 

Is work unless you assigned numbers 

|bal responses? 

| 1 

1 ! 

iThat's correct. 

So without assigning numbers to an 
ordinal e, you cannot do quantitative 

i 

could you? j 



That's correct 


measurement 

Q^i^That was my question. 

AJ S 8 S T ! Mwell, I'm sorry. It is jnot that 
you coulxtriTS do it. Let's just be clear. 

There are certain statistics that 

require numbers as inputs. And if tjhere are 

no numbers, you can't, by definitiori, execute 

i 

those statistics. There are other statistics 

i 

that don't require numbers and you cjan execute 
them. 
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Krosnick 

Q. I will give you this one. This is 
your marked version of your expert report. 

Will you take a look at that, please? 

I 

A. Yeah. | 

Could you turn to page 10 of the 




Q. 

report? 

A 3 

Q-l 

A .5 

I 

Qi 

A. 

Q. 

A.} 

Q._ 

ViViS«| 

cond4vl>-»^ 


Upper right is ten? 

Well, yes. 

Table one? 
iTable one. 

; I 

Okay. i 

I 

Do you see that? j 

Uh-huh. 

"Could you look at the variable 


Yes 



Yes. 

■Is that how you refer to it? 


What is that variable there? Do 
you see .21? Can you explain what that means? 


A. Yes. That variable is what we 
call a dummy variable, simply meaning it is 
coded dichotomously; respondents can take a 
value of either zero or one on it. 
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i 

i 

In this case, respondents who are 

I 

in the SGTB condition of the experiment take a 

i 

value of one, all other respondentsj take a 
value of zero. i 

i 

Because that variable ib analyzed 

i 

in thi^regression, in this pair ofj regression 
in the ItfSsr two columns where two ojther dummy 


variab 
this m 


about 



re present, condlv2 and condlv3, 
.21 coefficient that you asked 


I'm sorry. You misunderstood. 


asJ^ihg you not about the minus 


21, I'm 


asking ivou . about the .21 in regression one. 

A . Ifr s- l T m sorry. That would be cond4vl, 

VWlWiWW j 

not IvC^Jfhat would be in the uppejr left-hand 

corner l^i^ fhe numbers in Column 1. j 

i 

Sorry. Let's start thijs again. 
Cond4vl is also a dichdtomously 

i 

coded dummy variable coded "1," forj people in 
the control condition, and "0" for ^respondents 
in the other three conditions. 

j 

Because the ether two variables, 

s 

condv2 and condv3, are present in the 
occasion, then the meaning of condvl is to 
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Krosnick j 

compare the adjusted means for two groups, the 

j 

SGTB group and the control group, in terms of 
the dependent variable which is the motivation 
to quit index controlling for all of the 
demographic variables also included tin the 


equati 


differed 


controls 


right? [ 



j Simply stated, it is the 
jin the MTQ index between j the 
lip and the SGTB group; is that 


And thal 

motivate 


compare? 


.All right. Let's go on i to the 

yAsss 3 j 

next vakdyyole, cond4v2. 

A ^Si * Okay. I'll use your tercninology. 
And tha^Ls the difference between the means 
motivati^il^o quit and the SG group j as 
comparefl^ the SGTB group. j 

Q. ! And cond4v3, what is that? 

i 

A. That is the difference between the 

i 

means motivation to quit and the TB| group and 
the SGTB group. 

Q. Let's look at the number .21. 

A. Okay. | 

Q. What does that mean? 
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A. 


Krosnick ! 

It means that the difference in 


adjusted means between the control Condition 
and the SGTB condition is .21 on thje scale of 
motivation to quit index. i 

Q. And what does that mean|? What is 
.21 unljts of MTQ mean? 


than 



t 
iva 
motiva 


r ight ? 




I'm not sure what to sajy other 

i 

its on the scale. 

What is a unit? 

Well, the scale itself granges from 
and one means the maximum 

i 

n.to quit, five means the minimum 
to quit. | 

And .21 is difference; jis that 


"~x 


condit 



Q. 


In means between those jtwo 
on that scale, right. j 
And you've determined it's 


statistically significant, correct? 

i 

A. Yes, I have. i 

I 

Q. Now, we had a discussion before 

| 

about substantive significance, do ! you 
remember that? 

A. Not really. j 
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Krosnick 

Q. You wrote in your book jthat in 
addition to looking at statistical 
significance, you should also look 'at 
substantive significance to see if the 
differences really do matter. You jdon't 

rememiekthat discussion? : 

i 

You and I discussed that? 

Yes. 

Not particularly. I 

Well, you wrote in your| book -- 

i 

if I can jog your memory! here — on 

i 

your text, "It is always 
owever, to assess the substantive 
of a relationship between two 
Does that sound familiar? 

It may be. I haven't ljooked at 

„ 1 

the boo P a while. 

Qi '■ "An association of , 09 may be 
statistically significant but it isj not of 
much use in predicting the dependent 

variable's value. Researchers shoJld always 

| 

try to judge the substantive significance of 
relationships in addition to their (statistical 
significance." Okay? Sound familiar? 




SPKERION DEPOSITION SERVICES 
( 212 ) 490-3430 


http://legacy.library.ucsf.edBii/tidiffy<^fjM)0)tf|a«flv.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5917 





159 


1 

2 

3 






Krosnick i 

A. I will — I’ll take your word for 
it that is in the book if that's what you’re 
asking. 

Q. Are you familiar with the concept 
of substantive significance? 

Yes, I am. ! 

You were a couple of weeks ago. 
Okay. I 

As an expert in your field of 
did I get that right? 

Yes. ; 

Can you tell us if the J21 
.s substantively significant? 

Yes, it is. t 

Now, let’s assume that 4he value 

't. * 

not .21 but it was .20 and 

I 

Ly -- excuse me, and statistically 

I \ 

significant, okay? 

A. Yes. j 

Q. Would you still say it was 

substantively significant? j 



23 

A. 

Yes, 

I would. ! 

24 

Q. 

What 

i 

about 1.9 -- excuse: me, .19? 

25 

A. 

Yes, 

I would. 



SPHERION DEPOSITION SERVICES 
( 212 ) 490-3430 


http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offllfv.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5918 





160 


[ 


BEST 

COPY 


1 

2 

3 


Krosnick 




11 

. 2 * 




Q. 

Down to 

.15? 

A. 

Sure. 


Q. 

All the 

way down to .05 

A. 

Yes. 


Q. 

And all 

Yes . 

the way down to 


is thal 
you woi. 
signifif! 


question 
when w 



means? 


23 

A. 

w* 

Q. 

23 

on to reg 

24 

A. 

25 

the means 


01 ? 


So basically what you are saying 

^it is statistically significant, 

Ilso find it to be substantively 

|, 1 

i 

In this particular context, yes, I 

Now, let's move on to, I think the 
at you started to answer before 
a little bit of confusion. 

Condlv2? 

I 

Okay. I 

Can you tell me what that number 

I 

In — j 

What that predictor means? We're 
5sion three now. 

f 

Okay. That predictor is comparing 
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Krosnick j 

control condition versus the SG group. So 

that that is the difference between: the means 

i 

adjusted for the additional variables 

| 

controlled in the equation. 

Q. And can you tell me why;you were 
running^regression three? What is Ihat to 
test? J#* 1 

a L'ITIJ That is to test the differences 
control condition and in the SG 

i 

'tween the control condition in the 


And regression four? i 
Is for the same purpose.! 

I was — did you also run a 
J:o determine the statistical 
? with respect to the numfcjer of 
ticular respondent had heiard a 

particular message? Did you control 1 for that 

l 

as well? ; 



A. I'm not sure I understand. 

! 

Q. Could you look at Paragraph 3 of 
your report? I’m sorry. Paragraph |4, 

"I also tested Defendant's' 
hypothesis that hearing a greater number of 
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Krosnick I 

statements about the health effects.of smoking 

I 

increases the saliency of the message." Do 
you see that? 

A. Yes, I do. | 

i 

Q. The paragraph statementjis that 
you al&s^tested to determine whether the 
number i%f messages might affect the 
is answers? 

That's correct. 

I thought it says here that you 
fthat you reported your results in 

i 


two columns of table one? 

I 

That's correct. 

That's what I thought you said. 

So in regression three and 

'four, you were testing, as I 

| I 

lit, to see if there is aj difference 
in terms of the number of messages heard by 
the respondents? 

A. The number of messages jthe 

j 

respondents are exposed to, yes. 

i 

Q. Isn't that what I asked you 

before? 1 

j 

A. Maybe so. 
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Krosnick 


And the answers there look to 


be — excuse me. 

The regression values i(n 

regressions three and regressions four look to 

! 

be similar to the values generated (in 


regres 

that? 

by — 





one and regression two; jdo you see 

I don't understand what you mean 
.ar to what? 

j 

Well, you have compared in 
one, for example, we started with 


pd4v |||y^ r r ec t? 

AbskssssssS YeS . 


And you got a response jof .21 

units? ' 

Coefficient of .21, yes. 

The coefficient was .21. 

And we also see a negative .21 
units also significant — in fact,lyes, also 
significant in regression three; do you see 

that? i 

f 

A. That's correct. 

Q. Is one the inverse of the other? 

A. Yes, it is. 1 


23 

A. 

24 

Q. 

25 

A. 


SPHERION DEPOSITION SERVICES 
( 212 ) 490-3430 


http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offll<v.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5922 






1 

2 

3 


T \ 



23 

24 

25 


164 



Krosnick j 

! 

Q. So basically, the test in 

i 

regression one and two are running the same 
regression as three and four? j 

A. They're not the same, but they are 
comparing the same means, yes. 

d' K. j And that is because the j type of, 
the qualitative messages in the MTqJ index are 

rV! ' i 

the sarteiaa the quantitative, the number of 
messag^^H the MTQ index as well? ' 

That I don't understand. 

Can you separate out the types of 
jag^s^heard by SGTB, etcetera, from the 
number foretimes those messages werej heard? 

I'm sorry. I'm still njot 
followifng-4-t. 

Can I speak to the crude analyst 
next to^r|i^for a second? Maybe he can 
rephrase the question. 

How do you go' about analyzing the 

i 

group that got six messages? 

i 

A. Sorry. That didn't heljp either. 
How do I analyze the group that got' six? 

Q. You will get this one. j 

1 

A. Good. Looking forwardjto it. 
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Q. With respect to the grqup that got 

: 

six messages, can you tell me that (they are 
different because they got six mess-ages or 
because they were the group exposed to SGTB? 

A. Different from whom? 

i 

Different from somebody that may 



have gotten three messages. 

^ i 

iXJ Yes. That's the purposje of this 
analys^fy# Would you like me to explain the 


I 

purpose" 4 oT) this analysis? 

§ * Yes. Go ahead. 

The alternative hypothesis that I 

I 

was testing here is the idea that the SGTB 


group egl &essed greater motivation to quit 
simply ^■because they heard six messages, 
insteafPPF the fact that there were six 
messagflfj^ftom two different sources, one of 
whom had interests such that offering these 
messages conflicts with their self interests. 

Q. Everybody in the SGTB group got 

i 

six messages, correct? | 

A. Correct. 

Q. How many messages did people in 

the SG group get? 
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don't have 



Krosnick 

i 

Three. 

And in the TB group? 

Three. ; 

And in the control? | 

Zero. | 

£o you couldn't test because you 
e data to see what would have 

i 

feet if there were six messages 

J j 

e tobacco companies, because you 
e data for that? ! 

|I performed a test here j which I 

’ i 

formative with regard tojdrawing a 

that point which I'm happy to 

| 

u would like me to. 

Q.^^Why don't you first answer my 
questionNilrf then you can explain? 

have datci with 

relevance to the issues that you're raising. 

Q. Well you could not test, could 
you. Dr. Krosnick, to see the effects if the 

respondents had been exposed to six I tobacco 

! 

company messages? 

i 

A. If what you're saying is, Was 

i 

there a condition in this experiment in which 
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Krosnick ! 

respondents heard six messages? Certainly the 
answer to that is no. j 

i 

Q. Same with six on the Surgeon 
General messages? 

i 

A. That's correct. j 

You don’t have the data 1 there? 

[ 

I don't have those conditions in 

| 

t. But I have data informative 

I 

; e you’re raising. i 

t And the data on the issue I'm 

. i 

i 

reflected in regressions! three and 


That’s correct. 


Now go ahead and explain. 

Okay. If it were the jcase that 
merely |^&M#ing messages on this topic, no 
matter IffipHthey come from, increases the 
salienceor the health effects of smoking, as 
Professor Mathiowetz offered in her written 
report, then we would expect to see', in fact, 
the largest gap between the groups that heard 
three quotes each versus the control group 
that heard none. i 

Because there is evidence in the 
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Krosnick 

literature of what's called decreasing 
marginal returns from this sort of exposure. 

So each additional exposure to something is 

| 

less impactful than the prior ones.j And the 
most impactful one is the first exposure. 

K , Therefore, if one wantejd to test 
the simple hypothesis that simply hjearing 

jr" 

quotes matter from whom, causing changes 

in moti#^^on to quit, we would do exactly 
what wc ne here in the control group, the 
d the TB group. j 

i 

And what we found was njo 
ly significant differences between 
s. That means to me tha|t mere 




roi 


statis 

those 




volume ^f~-vmessages is unlikely to produce this 
changej^pi^ticularly if the messages are ones 
that p^^^ have been exposed to in isolation 
over a relatively wrong period of time. 


What's novel about the 


SGTB 


condition is the essentially contiguous 
presentation of the messages from two 
different sources. 

Q. Thanks. Are you done? j 

A. I’m done. 
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Krosnick ; 

i 

Q. All right. I want to return to 
the concept of substantive significance. 

A. Okay. ! 


i 


Q- 


Now, you draw the conclusion that 


smoking 

At 

higher 

Q 



because your regression value — your 

t 

coeffic|*^ntj excuse me, is .21, thai people in 
the SGTf^grOup were significantly more likely 

i 
! 

to, exc iLsl-uh e. were more likely to stop 
ahead. 

I 

People in the SGTB grou{j> had a 

in the motivation to quit index. 

i 

Right. Which was significant, 
statist:^^2y significant? j 

A.^^As compared, yes, with particular 
groups. 

: i 

Q^^ffi^And so you believe that|someone 

with a iftipilr score, a statistically 
significant higher score on the MTQ index 
would be more likely to quit smoking 
cigarettes? 

A. Yes. 

Q. If the coefficient was not 

statistically significant, you could not make 
that statement, could you? 


BEST 

copy 


SPHERJON DEPOSITION SERVICES 
(212) 490-3430 


http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offll<v.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5928 






170 



BEST 

COF'Y 


Krosnick I 

A. I would not make that statement. 

I 

Q. You would not make thatj statement? 

» 

A. (Witness nodding.) 

Q. Now, let me ask this question with 

respect to substantive significances. 

Let's look at an individual 
persorfT two individual persons on the MTQ 


index. 



I 
| 

Okay. 

I 

One gave answers pursuant to which 

i 

le to quantify at four, jfour, four 

i 

nd another gave answer which you 
|to quantify on. your interval scale 
ur, four and five. i 

Okay? So one would have an MTQ, I 

si ' 

if 4.0, whereas the other;fellow 

an MTQ of 4.25? ! 

i 

Sounds close enough. 

1 

Are my numbers correct? 

Sounds about right. 

Could you say that the individual 

[ 

who had the number, the MTQ, motivation to 
quit index of 4.25 was substantially more 
likely to quit smoking than the fdllow who had 



Q. 

A. 

Q. 
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1 


Krosnick 



4.0? Excuse me. I flipped them. j 

Could you say the one who had 4.0 

was substantially more likely to quit smoking 

j 

than the fellow who had 4.25? i 


A. 


Okay. 


I have to answer that in 


two wa 

doesn' 

litera 






^ ■ 1 ' t: 
terms 



The first is "substantially" 

e a technical meaning in! my 

i 
I 

^ Okay. Thought significantly? 

Good. You can't make a| statement 
articular cases being compared in 
atistical significance, j 
How about as a social psychologist? 


Could if somebody came to you land you 

hose 4.25 and 4.0, could you say 

i 

is significantly more likely to quit 
I I 

than the other? 

J 

A. I could not make a statement about 
the significance of that difference between 

l 

those two people. j 



Q. 


I'm going to move on to something 


easier, is that all right? 
A. Sure. 
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Krosnick j 

Q. You have listed this bo|ok on your 
reliance list. Okay? And I for the life of 


me can't figure out why. Could you 


share that 


with us. It is a book by Mike A. Males called 
"Smoked: Why Joe camel is still smiling." 


You re 



, I take it? 

I skimmed it. 


of you 5 
partici 


Mr. He 



Can you tell us for what portion 
Lnion you are relying upcjn this 
book? 

i 

None. I 

None? Can you tell us 'why 

j 

put it on your reliance jlist? 

Yes. I was asked to -7 should I 


f inishP— 


afternc 


Ah 


I'm sorry to laugh. It is Friday 

1 

I 

I 

I'm enjoying it myselfj 
I was as — I have described 
previously, I gathered a series of(books in a 
relatively arbitrary computer search to get 

background on the history of tobacco history. 

! 

This is one of the books that showed up in 
that search, and I skimmed those bpoks quickly 
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Krosnick i 

I 

to look for relative information of! any value 
in this case. 

i 

I was asked by the atto|rneys, 
after having mentioned that in a deposition, 
to list all of the books in that group that I 
could. h ad already returned all jof them to 
the library and I was able to identify a 


couple| 
So it 



ou 



:hem, which that was one 'of them. 

I 


you hav< 



.sted not by any decision I made. 

You do not intend to discuss that 

i 

stimony? 

No, I don't. i 

Now, in this third report — oh, 
new reliance list, I dijin't realize 
that, p&aulhave been doing some moire reading? 

Not necessarily. I'm not aware of 
when tiH^^liay have been provided tjo you all. 

In your supplemental rjeport there 
which you have in front of you, some of your 

J 

analysis depends on current or former smoking 
status of the respondents; is that correct? 

i 

A. Yes. 

| 

Q. If in your analysis ciirrent and 

former smokers were not defined correctly or 
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Krosnick 

accurately, would that affect your results? 

i 

A. Let me clarify what youj mean be if 
they were not — 

I 

Q. For example, if you had; some 
people who were former smokers or current 
smokers^ feuti you had miscategorized them as 
current^and former smokers, that would affect 


your re| 


>, would it not? 
Yes. 




OL j Have you done any tests! to see 
erb&Js&i have properly classified 
nd |jffe^ as current or former smbkers? 

i took at face value respondents’ 


answers ^fl Ptwo questions in the SRBI survey. 

X assume—%-kat' s what we are referring to? 

Qjjpl^r in the SRBI, yes, that'b right. 

I took at face value respondents' 
answers^^two questions nearing th|e beginning 
of the interview that asked about recent 
smoking and long-term smoking behavior. 

Q. Right. | 

A. You're asking if I did janything to 

i 

check whether those answers were colrrect? 

Q. Yes. Or to see whether somebody 
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Krosnick | 

slipped through your screen as a current 


or former 


smoker being classified as a former 
as a current. Did you have any additional 

I 

check on that? ! 


A. 


To see whether those answers to 


those fcarly questions were accurate? 


classi 



Correct. Or that you had properly 


them as current or former, 


to object 



MR. BSCHORR: I'm going 
16™that. He didn't classify them 

That's where I got thrown off, 


J MR. WILLIAMS: Oh, who classified 


MR. BSCHORR: Ask him. 

Who classified them? 

^ It depends what you mean by 


'classified' them." In other words, jwe asked 
these two questions about five cigarettes 
recently and 100 cigarettes over a lifetime. 
And on the basis of those answers, SRBI 

decided either to proceed with the interview 

i 

or not because they had some criteria for 
proceeding. 
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Krosnick | 

And so they made a decision about 
whether individuals should or shouljd not 
continue with the interview based o'n those 



And who — I'm sorry. 
No. No. 


Go ahead. 


And who developed those criteria, 
ettes? | 

They were given to me by attorneys 

llantine as standard practice in 

1 

ture. 

1 

I see. What was standard 

1 

ithe classification of current and 

tkers? j 

Yes. Defining "current" and 

Smokers. i 

1 

And tell me how "current" and 
"former" smokers were defined in y^ur study? 

A. My recollection was, Ij may get the 

1 

number slightly off, that a current smoker was 

i, 

somebody who had smoked at least five 
cigarettes in the last seven days; and that a 


"f orau 


former smoker is somebody who had 


not smoked 


at least five cigarettes in the last seven 
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Krosnick j 

days, but had smoked at least 100 cigarettes 
during their lifetime. j 

Q. And those were the conventions 

i 

given you by lawyers at Dewey Ballantine? 

A. Yes. 

| 

^ And have you ever seen those 

criteri any of the other literature? 



use of — 


Any other literature or 

| 

! Any other literature. 

Okay. I haven’t particularly 
criteria one way or the other in 
herature. 

Do you know, for example, how the 

i 

eral defines "current" and "former" 


i 



smoke rs|9—^ 





* Do you know how any, for example, 
the Institute of Medicine defines "current" 

i 

and "former" smokers? 

A. No. I 

Q. You just took that on face value, 

that that was a proper definition of "current" 
and "former" smokers; is that right? 


A. 


It was a reasonable definition. 
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yes. 


Krosnick 

r 

MR. WILLIAMS: Let’s go; off the 
record for a minute. Take about two 

minutes. Is that all right? j 

i 

MR. BSCHORR: Sure. 

K , THE VIDEOGRAPHER: The time is 
rT36 p.ni. and we're going offi the 



{Whereupon, a short recjess was 
Caked.) j 

^ THE VIDEOGRAPHER: The time is 
>2 ; p.m. We're back on the record. 
ilAMS: 

Okay. Going back to your 
of "current" and "formerj" smokers. 
If somebody was contacted and 
smoked |¥|pvl or more in the last seven days, he 


would be a current smoker; is that right? 

A. If I remember correctly with the 

i 

number. i 


BY MR. 


defini 



Q. 


But if he was four or more in the 


last seven days, four or fewer, excuse me, 

! 

four or fewer in the last seven days, he could 
slip down to the former smoker? | 
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A. That's correct. 1 

! 

Q. And you were given those 

conventions by the Dewey Ballantine lawyers? 
That's correct. 

Who in particular? 

I don't remember. 

f 

i 

Somebody? 

Yes. 

I 

No recollection of who? j 

i 

That's correct. 

Did you do any literature search 
those definitions were in(the 

9 ! 

No. 

Are you aware that there are 

i 

of "current" and "former" smokers 

1 
I 


rature? 

[ 

I'm aware that anytime anybody 
analyzes data, that they have to make a 
decision like I did about how to classify 



people. j 

i 

Q. And you don't know anybody who has 

! 

classified them as you have? 

A. I don't know one way or! another. 
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Krosnick 
You didn't — 

I haven't — 

You did not check? j 

That's correct. j 

i 

Are you familiar with the Tab 


f€ 


Teenage Attitudes and Preference"? 
Not by that name. But [if you told 

j 

me more., .Inf ormation. I might. 

Tabs one, tabs two? You're not — 

Numbers don't help. ! 

| 

How about the "Monitorijng the 


Yes, I'm familiar with [that. 

Did you check to see hojw "current" 
" smokers were defined in there? 

I'm not sure they're defined in 


How about the SUMHAS literature? 

I'm sorry. i 

i 

S-U-M-H-A-S. 

Would you mind telling jine what 
that initials stand for? It might jhelp. 

Q. Is it Substantive Use Rental 
Health Administration Survey? 
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Krosnick 


A. 

procedures. 
Q. 

A. 

Q. 



define 



Intervi 

A 


they d 


No, I don’t know about their 

j 

r 
I 
f 

You never heard of that survey? 

i 

That’s correct. 

You never heard of SUMffl\S? 

That's correct. | 

How about CDC? i 

I have heard about thejCDC, yes. 
Have you determined how they 

rent" and "former" smokers? 

! 

No, I have not. j 

How about NHIS, National Health 
rvey? j 

I know what those surveys are. 

Did you do any search to see how 
"current" and "former"! smokers? 

No, I have not. 

i 

MR. WILLIAMS: I got nothing 

I 

further. 

MR. BSCHORR: Thank yoju. I got 
just one or two questions. 

j 

MR. WILLIAMS: I hope ;it refers to 
my cross and not to somebody else's 
earlier. I 
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Krosnick 

EXAMINATION BY 
MR. BSCHORR: 

Q. Professor Krosnick, in putting in 

1 

your Supplemental Disclosure Report/ the third 
report, you set forth various tests .and 
analysets^jthat you did; is that correct? 

A^ Yes. 

^ Do any of those analyses that you 
^any of the basic opinions you’ve 
this case? 

^ No, they do not. 

< i 

Indeed, do any of the analyses 


did ch 
expressed 

* •■■y.V.VVv 



that y< 



the opi 



re reconfirm and strengthen that of 
rs you have given before? j 
Yes, they do. i 

J j 

So bottom line, the opinions you 
have gfvlnjin this case remain the same 
througl^^t? 

MR. WILLIAMS: I’ll object — 

A. Yes, they do. 

MR. WILLIAMS: — to form and 
leading. That’s okay. We will see you 
on Monday. 

THE VIDEOGRAPHER: The time is 
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Krosnick | 

5:46 p .ra., April 20, 20001. THis is the 


end of tape number two of the 


I 



videotaped — completes the videotaped 

i 

deposition of Jon A. Krosnick. j We are 
going off the record. j 

,(Time noted: 5:46 p.m.) ; 





JON A. !KROSNICK 


Subscribed 
thisL, 


d sworn to before me 
y of _ 2000. 

PUBLIC 
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CERTIFICATE 

f 

STATE OF NEW YORK ) ! 

: ss. I 

COUNTY OF NEW YORK ) 




I, MAYLEEN CINTRON, a Shorthand 
Iter and Notary Public wittjin and 

Ihe State of New York, do hereby 

_| j 

6 JL rt Jfy: | 

That JON A. KROSNICK, the witness 

ij deposition is hereinbefore set 

i I 

I, was duly sworn by me and that 

j 

^deposition is a true record of the 

I 

.any given by the witness: 

I further certify that I jam not 
PeTaT^ed to any of the parties po this 
.on by blood or by marriage [ and that 
no way interested in the outcome 
of this matter. J 

f 

IN WITNESS WHEREOF, I have 
hereunto set my hand this 20th! day of 
April, 2000. j 



,/v;/ 


'■! ■ - 


MAYLEEN CINTRON 


SPHER10N DEPOSITION SERVICES 
(212) 490-3430 


I 

r 


http://legacy.library.ucsf.e®ffittiDl%cl[QfiM^W|Offll<v.industrydocuments.ucsf.edu/docs/qyhl0001 


52434 5943 ■ 




1 

2 


185 


BEST 

COPY 



WITNESS 
DR- KROSNICK 


INDEX- 

EXAMINATION BY 
MR. MASSARO 
MR. WILLIAMS 


PAGE 

6 

182 


-EXHIBITS-:- 

EXHIBITS: j FOR I.D. 

KrosnidK^^dExhibit 1 , Supplemental ! 

Disclosure Report.j. 7 

Krosnic^^^iExhiblt 2, 4/4/01 Supplemental 
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KrosnidL^^Exhibit 3, Printout of : 

KrosniokJLsJfile "Output".j. 118 

Krosnir^J^yF.xhibit 4, "Variables in the 

.|. 136 

oOo 
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i 

j 

i 
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SUPPLEMENTAL DISCLOSURE OF DR- JON KROSNICK 



\ 



! In January and February, 2001 , 1 submitted expert reports in this action 

setting forth my opinions regarding the impact of the conduct, of the defendants on the 
knowledge and smoking behavior of Americans, and, in particular, subscribers of Blue 
Cross and / or Blue Shield plans 1 As a result of questioning at my deposition on March 
12, 2001, as well as rqiorts recently submitted by defendants’ experts Nancy A 
Mathiowetz, Rubin W Kjp Vtscusi and William E. Wecker, I went back and 

reviewed my opinions. My review confirmed that certain assertions made by 

defendants are i contr^dicted by the data and analyses. My review also reconfirmed my 

in my original expert and supplemental reports. The results of my 



ses of the SRB1 Survey Experiment 
i e sta tistical analyses I desenbed in my January report test differences 

cntal groups of respondents in terms of motivation to quit usmg 
a one-way anal|&t&*Q|Wanajice. 1 then conducted another analysis comparing the four 
groups in terms^M^r scores on the motivation to quit scale, this time controlling for 
the following v gg| gender, race, education, age, region of residence, number of 
telephone lines in the household, number of adults living in the household, income, status 
, as a current or former smoker, whether the respondents was ever a Blue Cross/Blue 
^Shield subscriber. The results of this analysis arc contained in the first two columns of 
Tabic 1. 


by reference 


i 


Mv qualifications are 


ser forth in ihe January report, which ! mcoiporate herein 
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best 

COPY 


3 My interpretation of these rest, it.-? is consistent with my earlier conclusions 
that hearing siaic.monts about the health effects of smoking horn both the Surgeon 

General and tobacco companies simultaneously significantly increased motivation to quit 
'p y ' ^because people found it especially persuasive to hear these messages from two different 
sources, especially when making these statements was against the material interests of 

r" , * 

one of the sources 

4. [ Msg* tested defendants’ hypothesis that hearing a greater number of 


statements aboufthe tjealth effects of smoking increases the saliency of that message, and 

Pt-I 

^whether it may spfiSplpfiave been this increase, rather than the particular sources 





providing the st 
between the SG 



|s, that produced the observed differences in motivation to quit 
qp and the control and SG groups. The results of this multiple 
nalyJiPiit^shown in the last two columns of Table 1 


this analysis, I found non-sigmficant differences between the 
control group aniK^^SG group and the TB group This analysis indicates that mere 
olume of quote^bear^does not increase motivation to quit and instead supports my 
initial assertion thaGtgglring quotes by tobacco companies would have been especially 
otent if made time that the Surgeon General was making comparable 

talements to IheMmrocan public in the 1960s through the same media. 

b In response to an issue raised by defendants’ expert Mathiowetz in her 

epori. 1 rested whether the impact of (lie experimental manipulations varied significantly 
eeri people who were current smokers and people who were former smokers. To do 
so. I added three interaction terms to the regression equations shown jn Table 1 
(interacting the ihree variables representing the experimental conditions with a variable 
dill wnnutiiig current and former smokers) When added to the tej'jession equations, 

2 

MY—542236.3 
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n<>ne nf these interactions ever had significant effects, meaning that I cannot reject the 
null Hypothesis tli.it lire experiment’s effects wete dillc-reni 1:1 the two groups. 

1 also tested the extent to which the four measures of motivation to quit in 
the SRBI questionnaire (how much respondents regret smoking, how unhappy it makes 
them that they smoke, how much they would like to quit smoking, and how likely they 
ate to try to quit) measured a single underlying construct Cronbach s alpha, a statistic 
ilia: ranges trom^io was .78 for current smokers, a figure that indicates sufficient 

covariation amoRg the items to justify treating, them as indicators of the concept of 

pr 7% 

jinotivation to qu ltefei^ mbach 1951) The correlation between the First two measures was 
[very similar amc^^^^Vent and former smokers (.55 and .47), indicating that the factor 
structure o! thes< &r&m& does not differ among fonne: smokers 
ecodi$$s&hf_- Cogadb^its of the Motivation to Quit Index 




ise to questioning at my deposition, I indicated that a large body 

d studies have a^^^^^ople to describe in quantitative terms the meanings of phrases 

tike those offeret^^j^g^ionse options in the constituents of the SRBI survey ’s measures 

)( motivation to a review of this literature, see Krosnick & Fabngar, 

ing, This research supports two pnncipal conclusions: (1) people’s 

average perceptit|^^^he meanings of these sorts of terms have been remarkably 

Consistent over the last five decades and across many different respondents populations, 

bid ( -) the amount of disagreement between people in tenns of their interpretations of the 

R | 

sifi^anings is rehitvelv small. These studies suggest that the perceived spacing of the 
response op’mns offered in the SRBI survey may have departed from equality to small 


degrees 
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9 In order lo confinn my initial results using these alternative spaemgs, I 

rescaled the ending number,. lur the response options in the SKJ3I surveys measures oi 

motivation to t|uii to reflect the perceived spaemgs suggested by these past studies. 

\lsing these figures, I recomputed an index of motivation to quit and reestnnated the 
regressions shown in Table 1 lestrng die differences between the four experimental 
ondations in terms of this new index. The results, shown in Table 2, illustrate that using 
is analytic pror£?km; Ural permits unequal spacing of the response options docs not alter 
te conclusions oyfic 4 ))alysis at all. 

elative Risk vs SbsoTilte Risk and the Risk Differential 

10 


ThjF*?fcPfl data allowed me to test whether perceptions of relative risk 

n5 ^ : ' 01 die nsk differentia] inspire quitting smoking To 
hake th^^lessn^^Vtransformed each of the three predictors into 6-level variables, 
ith approxirnatetyohe-^ixih of the cases in the sample at each level. This 
ansformation yie^^^feoniparable chslnbutions: for all three variables, to place them on a 
evel playing fid^^s^o speak 

11. Nel^Wmiputed the percentage of people at each level of each variable 
had quit smo|mJ>^Jhe proportions of quitters in each of the six groups defined by 
lative nsk are 39%, 3S%, 48%. 58%, 57%, 60%, respectively, moving from lowest 
Tceived nsk to highest perceived nsk The linear trend in these numbers was 
^^isticaily signi ficant (F( (. 1896) = 56 37, p<.001). The proportions of quitters in the 
groups defined by the risk differential did not increase as consistently: 39%, 55%, 
49%, 47%. 56%, 5n% respectively t he linear trend in these numbers was also 
statistically significant (Ml. IS’95| t ^ o0, p<.001) but was notable we.tkcr than the 
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linear trend yielded by relative risk And the proportions of quitters in the six groups 
defined by absolute risk showed nu linear fiend at all 49%, 5o%, 52%, 45%, 52%, 49% 
(F(l. 1930)= 1 05, n.s.). Tims, relative risk appears to be the risk measure most 
Consistently associated with quitting belravnor 

J 

12 I conducted two logistic regressions predicting a dichotomous variable 
Representing smoking status (coded 0 for former smokers and I for current smokers) 


jsuig perceived r^tefive^nsk, perceived absolute nsk. the perceived nsk differential (each 



coded from 1 to & 


artables. The p 


representing increasing perceived nsk), and the demographic control 
shown in Table 3. I did two analyses, one not controlling for 


mcome (to majurt^^^^nple size) and another controlling for income As shown by the 
^efficients at the|&s®saa|f the rwo columns, the effect of perceived relative risk is neeativi 


coefficients at the rwo columns, the effect of perceived relative risk is negative 

^rid stati^^^ly si|ii|PPfnt in both analyses, suggesting that increased perceived relative 
mhan<ife^8BBtl»ho< lri^fe^ ittine smoking. In contrast, the effects of absolute risk and the 
^rceived nsk are both non-significant, suggesting that they do not drive 

ffecistons to quit These analyses reinforce my opinion that perceived relative 

isk is a determioantot \Jheiher or not people smoke 


BEST 

COPY 


Wording of Survei 


iions Used to Measure Perceptions of Risk 


^ 13. Lastly, to further test and aj'frrm my design of the relative risk questions 

contained in the SR.BJ survey. 1 compared the SRB1 questions about 1,000 smokers and 


smokers to the Audits X Surv eys question about 100 smokers in temps of their ability 
ro predict smoking cessation I o make (his comparison appropriate, the Audits & 

Surveys measure of the perceived risk differential must be compared to the calculation of 
prrvtrived nsk differentia) tri'in ilu 1 SRBI survey Using die data from each survey, I 
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used these measures to predict smoking status, coded 0 for former smokers who had quit 
smoking oy the tunc of die interview and 1 for people currentl) smoking at die lime of 
tile interview 




14 To assets the relation, i conducted logistic regressions predicting quitting 
with the perceived risk differential (I divided perceived risk differential by 100 to make 
the resulting regression coefficients larger and easier to compare) The regression 
coefficient desfcjqyhmg the effect of perceived risk differential on smoking status in the 

1985 Audits <fc Surveys survey data is *.035, p—.01 5 (N~ 1752) Ln the 1997 Audits & 

r%Sy-' I 

Surveys sujv«^s||gg^ which had a considerably smaller number of current and former 

|on coefficient was a bit larger, - .047. but was non-significant (p~,89, 
^the regression coefficient estimating this same relation in the SRBI 
^t<. 001 (N-] 898). The observed coefficient is 77 e /i larger in the 
| U 15 198 5 Audits & Surveys data and 32% larger than in the I 997 
This comparison suggests that the SRJBI measure of risk 
feu error, which indicates that using of the based of 1,000 people did 
not compronii*e'f»e*^urcincnt quality. 
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1 ogistic Regressions Predicting Smolcung Status (Former vs Current) 
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New Vars.sav'. 


GET 

F1 L.E= * D: \ 2 000 Smoking Study\2000 Smoking Study Dataset - 

GET 

FILE= 'D:\2000 Smoking StudyNviscusi 1985\Viscusi 1905 Survey Data.sav'. 
COMPUTE q3 = q3/100 . 

EXECUTE . 

uOGI STIC REGRESSION VAR=q4 
/METHOD=ENTER q3 

/CRITERIA PIN{ .051 POUT( . 10) ITERATR(201 CUT( . S) 


Logistic Regression 


W 

F 


% 


Notes 


output Created- 

-28-MAR-2ooi 07 5.1:32 

Comments f/ < 

Input 

D:\2000 Smoking StudyViscusi 
1985\Viscusi 1985 Survey Data sav 


<none> 

^^S!le L 

SiK> 

Rows in : ' 

r* s *® S Tr@tjrking Data File 

3500 

Missing Value_ (|i'finition of Missing L 
Handling r 

Syntax 4 

gj&®a*i-defined missing values are 
"Beared as missing 

StQiiSTIC REGRESSION VAR-q4 
^»ETHOD=ENTER q3 

ib 

p* 

L 

iS^&'ERIA PIN{.05) POUT(.IO) 
TrERATE{20) CUT<5) . 

Resources_ ; .^iPapsed Time_| 

list 0:00:01.70 


Unweighted Cases* 
Selected Ca 


Unseiected Ca 
Total 
a. If weight is £ 

Dependent Van. 



Included in Analys 
Missing Cases 
Total 



Per cent 

*5CT 

49.9 
100.0 
.0 

100.0 


see classification table Jjpr the total number of cases 


ncoding 


Original Value ^ 

jgpitemal^alue 

1 ? 

2 _S 

tr 

^ -L. 




Block 0: Begffihing Block 
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Classification Table 3,4 ’ 



a. Constant is included in the model. 

b. The cut value is .500 




a- The cut value is .500 
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Variables in the Equation 


1 1 

B 

SE 

Wald 

df 

Sig 

Exp(B) 

yep 

03 

- 035 I 

TH5 

5 879 


_o15 

i 555” 

1 

Constant 

.024 1 

.054 

195 

i 

.659 | 

1 024 


a. Variable(s) entered on step 1 03 


GET 

FILE= 'D:\2000 Smoking StudyWIscusi I997\Viscusi 1997 Smoking 
COMPUTE lunge = lungc/100 . 

VARIABLE LA^ELS^lungc ’COMPUTE lunge = lungc/100 (COMPUTE)* 
EXECUTE . 

FREQUENCIES 

VARIABLES=SftttSker 

/order= Analysis 


Frequenc 



Notes 




-2 gTORF 2 00 ' ffl 7 :55 ? n ' 

|00 Smoking StudyWIscusi 
^99|jWiscusi 1997 Smoking 
" set.sav 

i> 

i> 
l> 


Filter 
Weight 
it File 
cplows in Working • 

ta File 

finition c&MtfiSing 



>tal Values Allowed p 
Elapsed Time L 


1013 

Iser^defined missing values are 
as missing. 

|t>cs are based on all cases 
ralid data 
IUENCIES 
f'"VARtABLES=smoker 
S P^)ER= ANALYSIS . 

18724 

_ 0 : 00 : 00.22 



N-Vali3-! 

ion 

Missing 

m 2 


SMOKER 


-|SS9SS 

frequency 

Percent 

Valid Percent 

Cumulative 

Percent 

valid 1 

245 

“ 24.2 

24 2 

24 2 

2 

271 

26 8 

26 6 

51.0 

3 

495 

48 9 

49 0 

100 0 

Total 

1011 

99 8 

100.0 


Missing System 

2 

2 



Total 

1013 

100 0 




Dataset.sav'. 


logistic regression vAR=smoker 

/METHOD=ENTER lungeest 
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'/CRITERIA PIN ( .OS) POUT(.IO) ITERATE (20} CUT(.S) 

Logistic Regression 

Notes 


Uutput Created 

Comments 

Input 



Missing Vj 

Handling 

Syntax 


Resources' 



Data 


Filter 
'eight 
plit File 
N of Rows in 
..Working Data File 
finition of Missing 



apsed Time 


-28-MAR-200T 57:54:53' 

D:\2Q00 Smoking StudyWIscusi 
1997\Viscusi 1997 Smoking 
Dataset sav 
<none> 

<none> 

<none> 


1013 


User-defined missing values are 
treated as missing 
LOGISTIC REGRESSION 
=smoker 

:THOD=ENTER lungcest 
/CRITERIA PIN(,05) POUT(.IO) 
1T©RATE<20) CUT(.5) . 


- s 


0:00:00 99 


ase Processing Si 


Unweighted Oases' 
tierectea oa ' " 


Unselected 

Total 



Included in Analyjs 
issin^Cases 
Total 



M 

Percent 

516 

SITS' 

497 

49.1 

1013 

100.0 

0 

.0 

1013 

100.0 


a. If weigi 



r ect. see d a s s[ficatiOn tabie for the total number of cases. 


Dependent Encoding 


Original Valuep 

Eternal Value 

2 ’ SSI 

0 0 

^ 1 



Block 0: 




ning Block 

Classification Table*-* 3 


- 

Predicted 


SMOKER 

Percentage 

Correct 

Obs^jyell.j 

1 

2 

btep (J SWlM&W 1 

0 

245 

-T5" 

2 

0 

271 

100.0 

Overall Percentage 



52 5 


a Constant is included in the model 
b. The cut value is .500 
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Variables in the Equation 



Variables not in the Equation 



T \ 

Block 1: = Enter 
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Variables in the Equation 


1 1 

i b i 

1 . 1 

| Wald 

df 

I s, g 

1 E*P(S) ! 

aep 




M HUB 

1 

a^rni.1 


1 

Constant | 

! .024 | 

054 | 

.195 ] 

1 

.659 | 

i 1 024 | 


a. Variable(s) entered on step 1: Q3 


GET 

FILE" 1 D:\2000 Smoking StudyXVIscusi 1997\Viscusi 1997 Smoking Dataset 
COMPUTE lunge = lungc/100 . 

VARIABLE I$TbEL%, lunge ’COMPUTE lunge = lungc/100 (COMPUTE) ' . 

EXECUTE 
FREQUENCIES 
VARIABL 
/ORDER- 



Frequen 


Output Cres 
Comments 


SMOKER 


No( 




mm 

nun 

1 Missing^-- 

21 

21 



Filter 
Weight 
it File 
N ot Row: 
ata File? 
efinitiort 

f le¬ 

ases Used 


Total Values Allow 
lapsed Time 


2£MAR-2001 07:53.21 

000 Smoking StudyWIscusi 
TWiscusi 1997 Smoking 
aset.sav 
ne> 
ne> 
me> 

1013 

User-defined missing values are 
ited as missing 
sties are based on all cases 
valid data. 

QUENCIES 
IABLES=smoker 
DER= ANALYSIS 

18724 
0 : 00 : 00.22 


SMOKER 



Frequency 

Percent 

Valid Percent 

Cumulative 

Percent 



24 2 

- 7TT 

- 7TT 

2 

271 

26.8 

26 8 

510 

3 

495 

48 9 

49.0 

100 0 

Total 

1011 

99 8 

1000 


Missing System 

2 

2 



Total 

1013 

ioo o 




LOGISTIC REGRESSION VAR-smoker 
/METHOD=ENTER lungeest 


sav ' . 


cn 

ro 

-r* 

co 

cn 

CO 

CD 

"•J 
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/CRITERIA PIN ( .05) POUT(.10) ITERATE(20) CUT(.5) 


Logistic Regression 


Notes 


-2S-MAR-2001 07 54 53 

D:\2000 Smoking StudyWlscusi 
1997\Viscusi 1997 Smoking 
Dataset, sav 
<none> 

<none> 

<none> 

1013 

User-defined missing values are 
treated as missing 
LOGISTIC REGRESSION 
“Srnoksr 
/METHOD=ENTER lungcest 
/CRITERIA PIN(.OS) POUT(.IO) 
TiRATE<20) CUT(.5) . 

0:00:00.99 


Output Created 

Comments 

Input 


Missing Va 
Handling 
Syntax 


Resources 



Data 

"Vilter 
'eight 
Split File 
of Rows in 
.Forking Data File 
befinrtion of Missing 


lapsed Time 



ase Processing S|jm 



Unweighted C3s«§f 

( L ~>r A 

OvIvsAvU vOu 



in Analysis 
Missinjgj^&es 
Total 


Unselected Cases 
Total 





N 


“57T 

497 

1013 

0 

1013 


Percent 

-5CT 

49 1 
100.0 
.0 

100.0 


'ect, see classificatn 
Encoding 


Original Valuers 

iglnlemal Value 

T 

: m 

2 ' 

et r 

2 _!_ 


Block 0: 



tor the total number of cases. 


ining Block 

Classification Table*' b 



Predicted ] 


SMOKER 

Percentage 

Correct 

1 

2 

"Step U SMOKER 1 " 

0 

i ''BHI 

a .<K| 

2 

0 

271 


Overall Percentage 



9 


a Constant is included in the model, 
b. The cut value is .500 
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Variables in the Equation 


Wald 


Exp<B) 


Variables not in the Equation 


Score 




Overall Statistics 


Block 1: 

Omi 


= Enter 

sts of Model Coefficients 


hi-square 


KICI 


LifeSI 


I Summary 




Cox & Snell 
likelihood I R Square 


a. The cut vakje wSSOO 


Predicted 

SMOKER 

Percentage 

1 1 

2 

Correct 


00 

; 


Vari 

L____ 


m\ 


W*Zt£ 


kWtl 


the Equation 


Wald 


1.298 




a. Variable(s) entered on step 1: LUNGCEST. 


►ZWI 


Sig. 


.255 


W:UZ1 
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